00000001:02000400:0.0F:1788652038.801258:0:2959:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing set_hostid 00000001:02000400:0.0:1788652060.668066:0:3180:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1788652062.739145:0:3239:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 791 MB/s 00000001:01000000:3.0F:1788652062.989264:0:3239:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1423 MB/s 00000001:01000000:3.0:1788652063.238830:0:3239:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3695 MB/s 00000020:02000000:2.0F:1788652064.169066:0:3271:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_g557ce73 00000400:02000000:2.0:1788652065.851384:0:3286:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.150@tcp [8/256/0/180] 00008000:02000000:0.0:1788652070.946864:0:3436:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788652124.048878:0:5239:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788652136.624904:0:5812:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788652136.624910:0:5812:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788652136.625052:0:5812:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000b6fa4e50 00000080:02000400:0.0:1788652136.625062:0:5812:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1788652136.631125:0:5812:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1788652136.631141:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788652136.631572:0:5812:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000f3718d7d) 00000020:00000080:1.0:1788652136.631593:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788652136.647037:0:5812:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788652136.647580:0:5812:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788652136.690676:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788652136.690716:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788652136.690736:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788652136.690818:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788652136.690846:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788652136.691174:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788652136.691182:0:5812:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788652136.691192:0:5812:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x340ed74ef02a722c 00000020:01000004:3.0:1788652136.691199:0:5812:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788652136.691203:0:5812:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788652136.691207:0:5812:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b6fa4e50 from MGS 00000020:01000004:3.0:1788652136.691211:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788652136.691230:0:5812:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000026eaff04) 00000020:00000080:3.0:1788652136.691241:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788652136.691340:0:5812:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b6fa4e50 from MGS, refs=2 00080000:01000000:3.0:1788652136.691346:0:5812:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788652136.691352:0:5812:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x340ed74ef02a723a 00000100:00100000:3.0:1788652136.691445:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788652136.691569:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788652136.691574:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788652136.696990:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788652136.697003:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788652136.697816:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788652136.697998:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788652136.698003:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788652136.698787:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788652136.698796:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788652136.699158:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788652136.699166:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788652136.700578:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652136.700583:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652136.700585:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652136.701030:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652136.701033:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652136.701035:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652136.705861:0:5812:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788652136.709956:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1788652136.955232:0:5812:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2543 MB/s 00000001:01000000:1.0:1788652137.204919:0:5812:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2799 MB/s 00000001:01000000:2.0:1788652137.457052:0:5812:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 420 MB/s 00000001:01000000:3.0:1788652137.707580:0:5812:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 567 MB/s 00080000:10000000:3.0:1788652137.714927:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1788652137.738468:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788652137.744917:0:5812:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788652137.744933:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788652137.744935:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788652137.751365:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788652137.752153:0:5812:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788652137.752214:0:5812:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788652137.752526:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788652137.752553:0:5812:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788652137.753003:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788652137.753178:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788652137.753184:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788652137.756567:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788652137.756579:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788652137.757137:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788652137.757145:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788652137.757855:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788652137.757875:0:5812:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.150@tcp' 00000020:01000004:0.0:1788652137.757877:0:5812:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788652137.757973:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.150@tcp (typ=mgc) 00000020:00000080:0.0:1788652137.757995:0:5812:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.150@tcp (000000006cf594e7) 00000020:00000080:0.0:1788652137.758014:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788652137.758156:0:5812:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000936be941@MGC192.168.203.150@tcp: add connection 192.168.203.150@tcp at head 00010000:00010000:0.0:1788652137.758404:0:5812:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.150@tcp-0 is initialized 00000040:01000000:0.0:1788652137.758411:0:5812:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.150@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788652137.758804:0:5831:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788652137.759975:0:5832:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788652137.760052:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.150@tcp (uuid f811a652-691e-4a40-b660-977a4758dd08) 00000020:00000080:1.0:1788652137.760074:0:5812:0:(genops.c:1385:class_connect()) connect: client f811a652-691e-4a40-b660-977a4758dd08, cookie 0x340ed74ef02a7248 00000100:00080000:1.0:1788652137.760086:0:5812:0:(import.c:545:import_select_connection()) MGC192.168.203.150@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788652137.760091:0:5812:0:(import.c:665:import_select_connection()) MGC192.168.203.150@tcp: import 00000000936be941 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:1.0:1788652137.760142:0:5812:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000076b17156 x1875537627709568/t0(0) o250->MGC192.168.203.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788652137.760230:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000076b17156 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f811a652-691e-4a40-b660-977a4758dd08:3302:1875537627709568:0@lo:250: 00000100:00100000:3.0:1788652137.760341:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788652137.760400:0:5812:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f811a652-691e-4a40-b660-977a4758dd08->MGS 00000020:01000004:1.0:1788652137.760417:0:5812:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788652137.760422:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788652137.760435:0:5812:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000389e2228) 00000020:00000080:1.0:1788652137.760445:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788652137.768898:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627709568 00000100:00100000:0.0:1788652137.768915:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627709568 00000100:00100000:0.0:1788652137.768956:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788652137.768965:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca63ff99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3302:x1875537627709568:12345-0@lo:250: 00010000:00080000:0.0:1788652137.768997:0:5828:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f811a652-691e-4a40-b660-977a4758dd08@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:0.0:1788652137.769025:0:5828:0:(genops.c:1385:class_connect()) connect: client f811a652-691e-4a40-b660-977a4758dd08, cookie 0x340ed74ef02a7256 00000100:00080000:0.0:1788652137.769165:0:5828:0:(import.c:65:import_set_state_nolock()) 0000000018564bd2 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788652137.770683:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca63ff99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+5:3302:x1875537627709568:12345-0@lo:250: Request processed in 1713us (10337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652137.770696:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788652137.778052:0:3302:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.150@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788652137.778068:0:3302:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.150@tcp: connect to target with instance 0 00000100:00080000:3.0:1788652137.778077:0:3302:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.150@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788652137.778083:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788652137.778087:0:3302:0:(import.c:65:import_set_state_nolock()) 00000000936be941 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788652137.778092:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788652137.778100:0:3302:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788652137.778108:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000076b17156 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f811a652-691e-4a40-b660-977a4758dd08:3302:1875537627709568:0@lo:250: 00000100:00100000:1.0:1788652137.784195:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788652137.784887:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788652137.784895:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788652137.786296:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788652137.786407:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788652137.787521:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788652137.787530:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788652137.788286:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788652137.788627:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788652137.788634:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788652137.789285:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788652137.789294:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788652137.859291:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788652137.859766:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788652137.859796:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788652137.861499:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788652137.861510:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788652137.865180:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788652137.865413:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788652137.865421:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788652137.866406:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788652137.866415:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788652137.867077:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788652137.867233:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788652137.867246:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788652137.868051:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788652137.868060:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788652137.868571:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788652137.868734:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788652137.868738:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788652137.870463:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788652137.870476:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788652137.903176:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788652137.903393:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788652137.903400:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788652137.906462:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788652137.906475:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788652137.907411:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788652137.907420:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788652137.909161:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788652137.909187:0:5812:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788652137.909193:0:5812:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.150@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788652137.909337:0:5812:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.150@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788652137.909371:0:5812:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.150@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788652137.909376:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788652137.909377:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788652137.909378:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788652137.909379:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788652137.909380:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788652137.909382:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788652137.909383:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788652137.909385:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788652137.909386:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788652137.909387:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788652137.909388:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788652137.909389:0:5812:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788652137.909392:0:5812:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788652137.909394:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788652137.909396:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788652137.909397:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788652137.909398:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788652137.909399:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788652137.909404:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788652137.909405:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788652137.909406:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788652137.909407:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788652137.909407:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788652137.909408:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788652137.909409:0:5812:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788652137.909434:0:5812:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788652137.909450:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e054d21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627709696:0@lo:253: 00000100:00100000:1.0:1788652137.909520:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652137.909605:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 0000000019000c79 going to sleep for 11 seconds 00000100:00100000:3.0:1788652137.909671:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627709696 00000100:00100000:3.0:1788652137.909679:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627709696 00000100:00100000:3.0:1788652137.909762:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788652137.909799:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c890df44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+5:5812:x1875537627709696:12345-0@lo:253: 20000000:01000000:3.0:1788652137.909931:0:5830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788652137.909935:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788652137.910185:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788652137.910233:0:5830:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788652137.910492:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788652137.919824:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788652137.920141:0:5830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788652137.920146:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788652137.920152:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788652137.920155:0:5830:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788652137.920173:0:5830:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788652137.920409:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788652137.920693:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788652137.920706:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788652137.920756:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788652137.920844:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788652137.920884:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788652137.920977:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788652137.920994:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788652137.921045:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788652137.921053:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788652137.921085:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788652137.921092:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788652137.921123:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788652137.921172:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788652137.921204:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788652137.921210:0:5830:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788652137.921224:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788652137.921435:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788652137.921444:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788652137.921490:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788652137.921527:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788652137.921577:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788652137.921589:0:5830:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788652137.921673:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788652137.921682:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788652137.921726:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788652137.921764:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788652137.921833:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788652137.921845:0:5830:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788652137.921929:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788652137.921938:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788652137.921971:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788652137.922008:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788652137.922184:0:5830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788652137.922236:0:5830:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788652137.922244:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788652137.926415:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788652137.927149:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788652137.927179:0:5830:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.150@tcp for mdt 20000000:01000000:2.0:1788652137.927182:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.150@tcp (null) (null) (null) 00000040:00080000:2.0:1788652137.927222:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788652137.927230:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788652137.927259:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788652137.927266:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.150@tcp (null) (null) 00000040:00080000:2.0:1788652137.927307:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788652137.927318:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788652137.927351:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788652137.927387:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788652137.927462:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788652137.927466:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788652137.927469:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788652137.927495:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788652137.927498:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788652137.927525:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788652137.927527:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788652137.928171:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788652137.928420:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788652137.928474:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788652137.928504:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1788652137.928514:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788652137.928516:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788652137.929152:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1788652137.929361:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788652137.929410:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1788652137.929477:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1788652137.929490:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788652137.929493:0:5830:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1788652137.929497:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788652137.929499:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788652137.929503:0:5830:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788652137.929509:0:5830:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788652137.931456:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1788652137.934752:0:5830:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788652137.947631:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1788652137.947685:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1788652137.947813:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1788652137.947836:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788652137.947857:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d3d7793b/0x340ed74ef02a725d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652137.947875:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d3d7793b/0x340ed74ef02a725d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652137.947885:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d3d7793b/0x340ed74ef02a725d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652137.947891:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d3d7793b/0x340ed74ef02a725d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652137.947897:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d3d7793b/0x340ed74ef02a725d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652137.947911:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d3d7793b/0x340ed74ef02a725d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652137.947917:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d3d7793b already unused, calling callback (0000000062669929) 00010000:00010000:2.0:1788652137.947921:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d3d7793b/0x340ed74ef02a725d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652137.947928:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d3d7793b/0x340ed74ef02a725d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652137.947941:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d3d7793b/0x340ed74ef02a725d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652137.947948:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d3d7793b/0x340ed74ef02a725d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652137.947953:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d3d7793b/0x340ed74ef02a725d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788652137.947968:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788652138.229517:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c890df44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+5:5812:x1875537627709696:12345-0@lo:253: Request processed in 319742us (319990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652138.229536:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788652138.229654:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e054d21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627709696:0@lo:253: 10000000:01000000:1.0:1788652138.229670:0:5812:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788652138.229673:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788652138.229675:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788652138.229676:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788652138.229677:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788652138.229678:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788652138.229679:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788652138.229680:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788652138.229682:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788652138.229683:0:5812:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788652138.229684:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788652138.229686:0:5812:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788652138.229705:0:5812:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b6fa4e50 from lustre-MDT0000 10000000:01000000:1.0:1788652138.229729:0:5812:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788652138.229732:0:5812:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788652138.229737:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cbe4b174d40 10000000:01000000:1.0:1788652138.229741:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788652138.229748:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cbe4b174d40 from 1 10000000:01000000:1.0:1788652138.229751:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788652138.229807:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 000000007601e071/0x340ed74ef02a7264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652138.229828:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 000000007601e071/0x340ed74ef02a7264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652138.229838:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 000000007601e071/0x340ed74ef02a7264 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652138.229854:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e054d21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627709824:0@lo:101: 00000100:00100000:1.0:1788652138.229890:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652138.229940:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 000000000db75d34 going to sleep for 11 seconds 00000100:00100000:2.0:1788652138.229995:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627709824 00000100:00100000:2.0:1788652138.230002:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627709824 00000100:00100000:2.0:1788652138.230062:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788652138.230070:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d85d5c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+5:5812:x1875537627709824:12345-0@lo:101: 00010000:00010000:2.0:1788652138.230083:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652138.230098:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d3d7793b/0x340ed74ef02a726b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a7264 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.230133:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d3d7793b/0x340ed74ef02a726b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a7264 expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.230142:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d3d7793b/0x340ed74ef02a726b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a7264 expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.230151:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d3d7793b, rc 0) 00000100:00100000:2.0:1788652138.230266:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d85d5c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+6:5812:x1875537627709824:12345-0@lo:101: Request processed in 197us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652138.230274:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788652138.230506:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e054d21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627709824:0@lo:101: 00010000:00010000:3.0:1788652138.230527:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 000000007601e071/0x340ed74ef02a7264 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a726b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652138.230535:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 000000007601e071/0x340ed74ef02a7264 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a726b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652138.230591:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a19b2d01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627709952:0@lo:501: 00000100:00100000:3.0:1788652138.230619:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652138.230649:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 00000000810e9737 going to sleep for 11 seconds 00000100:00100000:2.0:1788652138.230704:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627709952 00000100:00100000:2.0:1788652138.230709:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627709952 00000100:00100000:2.0:1788652138.230742:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788652138.230748:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003934ff12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+6:5812:x1875537627709952:12345-0@lo:501: 00000100:00100000:2.0:1788652138.231048:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003934ff12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+6:5812:x1875537627709952:12345-0@lo:501: Request processed in 299us (428us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788652138.231055:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788652138.231128:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a19b2d01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627709952:0@lo:501: 10000000:01000000:3.0:1788652138.231150:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788652138.231166:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 000000007601e071/0x340ed74ef02a7264 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a726b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652138.231174:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: 000000007601e071/0x340ed74ef02a7264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a726b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652138.231181:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cbe50c46000 10000000:01000000:3.0:1788652138.231185:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788652138.231188:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cbe50c46000 10000000:01000000:3.0:1788652138.231191:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788652138.231193:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cbe50c46000 from 1 10000000:01000000:3.0:1788652138.231195:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788652138.231275:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 000000001f2268a6/0x340ed74ef02a7272 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652138.231282:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 000000001f2268a6/0x340ed74ef02a7272 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652138.231299:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 000000001f2268a6/0x340ed74ef02a7272 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652138.231423:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a19b2d01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627710080:0@lo:101: 00000100:00100000:3.0:1788652138.231450:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652138.231476:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 00000000810e9737 going to sleep for 11 seconds 00000100:00100000:1.0:1788652138.231533:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627710080 00000100:00100000:1.0:1788652138.231538:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627710080 00000100:00100000:1.0:1788652138.231572:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788652138.231579:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006527cd89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+6:5812:x1875537627710080:12345-0@lo:101: 00010000:00010000:1.0:1788652138.231587:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652138.231598:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007362d4a8/0x340ed74ef02a7279 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a7272 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652138.231614:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007362d4a8/0x340ed74ef02a7279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a7272 expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652138.231622:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007362d4a8/0x340ed74ef02a7279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a7272 expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652138.231630:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007362d4a8, rc 0) 00000100:00100000:1.0:1788652138.231668:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006527cd89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+7:5812:x1875537627710080:12345-0@lo:101: Request processed in 90us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652138.231673:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788652138.231822:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a19b2d01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627710080:0@lo:101: 00010000:00010000:3.0:1788652138.231833:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 000000001f2268a6/0x340ed74ef02a7272 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7279 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652138.231840:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 000000001f2268a6/0x340ed74ef02a7272 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a7279 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652138.231850:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788652138.231863:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 000000001f2268a6/0x340ed74ef02a7272 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7279 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652138.231869:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: 000000001f2268a6/0x340ed74ef02a7272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7279 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652138.231874:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788652138.231878:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788652138.231882:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cbe50c46000 10000000:01000000:3.0:1788652138.231884:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788652138.231887:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788652138.231888:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788652138.231901:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 00000000c6622332/0x340ed74ef02a7280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652138.231912:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 00000000c6622332/0x340ed74ef02a7280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652138.231918:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 00000000c6622332/0x340ed74ef02a7280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652138.231929:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a19b2d01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627710208:0@lo:101: 00000100:00100000:3.0:1788652138.231953:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652138.231969:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 00000000810e9737 going to sleep for 11 seconds 00000100:00100000:2.0:1788652138.232058:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627710208 00000100:00100000:2.0:1788652138.232063:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627710208 00000100:00100000:2.0:1788652138.232094:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788652138.232100:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1ea6f6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+7:5812:x1875537627710208:12345-0@lo:101: 00010000:00010000:2.0:1788652138.232107:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652138.232116:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000674db3dc/0x340ed74ef02a7287 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a7280 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.232129:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000674db3dc/0x340ed74ef02a7287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a7280 expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.232148:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000674db3dc/0x340ed74ef02a7287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a7280 expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.232153:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000674db3dc, rc 0) 00000100:00100000:2.0:1788652138.232186:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1ea6f6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+8:5812:x1875537627710208:12345-0@lo:101: Request processed in 86us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652138.232191:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788652138.232566:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a19b2d01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627710208:0@lo:101: 00010000:00010000:3.0:1788652138.232578:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 00000000c6622332/0x340ed74ef02a7280 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7287 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652138.232584:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 00000000c6622332/0x340ed74ef02a7280 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a7287 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652138.232627:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a19b2d01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627710336:0@lo:501: 00000100:00100000:3.0:1788652138.232665:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652138.232684:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 00000000810e9737 going to sleep for 11 seconds 00000100:00100000:2.0:1788652138.232736:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627710336 00000100:00100000:2.0:1788652138.232740:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627710336 00000100:00100000:2.0:1788652138.232838:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788652138.232846:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000917c9688 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+8:5812:x1875537627710336:12345-0@lo:501: 00000100:00100000:2.0:1788652138.233046:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000917c9688 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+9:5812:x1875537627710336:12345-0@lo:501: Request processed in 201us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652138.233054:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788652138.233114:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a19b2d01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627710336:0@lo:501: 00000100:00100000:3.0:1788652138.233137:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a19b2d01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627710464:0@lo:503: 00000100:00100000:3.0:1788652138.233173:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652138.233552:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 00000000810e9737 going to sleep for 11 seconds 00000100:00100000:1.0:1788652138.233614:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627710464 00000100:00100000:1.0:1788652138.233626:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627710464 00000100:00100000:1.0:1788652138.233661:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788652138.233666:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8a6b59f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+9:5812:x1875537627710464:12345-0@lo:503: 00000100:00100000:1.0:1788652138.233856:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8a6b59f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+9:5812:x1875537627710464:12345-0@lo:503: Request processed in 190us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652138.233864:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788652138.233949:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a19b2d01 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627710464:0@lo:503: 00000100:00100000:3.0:1788652138.234556:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a19b2d01 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:5858:1875537627710592:0@lo:502: 00000100:00100000:3.0:1788652138.234604:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652138.234636:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 00000000361d932a going to sleep for 11 seconds 00000100:00100000:1.0:1788652138.234697:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627710592 00000100:00100000:1.0:1788652138.234701:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627710592 00000100:00100000:1.0:1788652138.234736:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788652138.234743:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a95150a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+9:5858:x1875537627710592:12345-0@lo:502: 00000100:00100000:1.0:1788652138.234931:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a95150a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+9:5858:x1875537627710592:12345-0@lo:502: Request processed in 189us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652138.234938:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788652138.236108:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a19b2d01 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:5858:1875537627710592:0@lo:502: 00000020:01000000:3.0:1788652138.236144:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652138.236156:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652138.236159:0:5858:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788652138.236163:0:5858:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788652138.236166:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788652138.236181:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000000ab635ad) 00000020:00000080:3.0:1788652138.236414:0:5858:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788652138.236422:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788652138.236497:0:5858:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788652138.236504:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x340ed74ef02a7295 00000020:00000080:3.0:1788652138.236741:0:5858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788652138.236746:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652138.236749:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652138.236751:0:5858:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788652138.236753:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652138.236757:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652138.236758:0:5858:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788652138.236761:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788652138.236769:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000003e0440ce) 00000020:00000080:3.0:1788652138.238530:0:5858:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788652138.238542:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788652138.238545:0:5858:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788652138.238547:0:5858:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788652138.238556:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788652138.238627:0:5858:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b6fa4e50 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788652138.238655:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000003b46058) 00000020:00000080:3.0:1788652138.238665:0:5858:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788652138.238734:0:5858:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788652138.238755:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x340ed74ef02a72aa 00000020:00000080:3.0:1788652138.238926:0:5858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788652138.238932:0:5858:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788652138.238937:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x340ed74ef02a72b1 00080000:01000000:3.0:1788652138.238942:0:5858:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788652138.238946:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x340ed74ef02a72b8 00080000:10000000:3.0:1788652138.239537:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788652138.239753:0:5858:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788652138.244425:0:5858:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788652138.337602:0:5858:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788652138.338016:0:5858:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788652138.341504:0:5858:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788652138.341818:0:5858:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788652138.400514:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000b15fc089) 00000020:00000080:3.0:1788652138.400537:0:5858:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788652138.400700:0:5858:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788652138.400716:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x340ed74ef02a72c6 00000020:00000080:2.0:1788652138.405421:0:5858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788652138.406825:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788652138.480693:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788652138.527161:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788652138.566626:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788652138.617442:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788652138.655382:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1788652138.701183:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x340ed74ef02a72cd 00000020:00000080:0.0:1788652138.701614:0:5858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788652138.701626:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788652138.701633:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652138.701635:0:5858:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788652138.701650:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788652138.701660:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652138.701662:0:5858:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788652138.701665:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788652138.701667:0:5858:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788652138.701669:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788652138.701671:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652138.701673:0:5858:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788652138.701675:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788652138.701679:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652138.701680:0:5858:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788652138.701684:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788652138.701723:0:5858:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1788652138.701814:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036d4d456 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:5858:1875537627710720:0@lo:502: 00000100:00100000:0.0:1788652138.701904:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652138.701960:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 0000000039ed51a0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652138.701984:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627710720 00000100:00100000:0.0:1788652138.701990:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627710720 00000100:00100000:0.0:1788652138.702027:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788652138.702035:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d35b27e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+9:5858:x1875537627710720:12345-0@lo:502: 00000100:00100000:0.0:1788652138.702456:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d35b27e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+9:5858:x1875537627710720:12345-0@lo:502: Request processed in 421us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652138.702464:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788652138.702513:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036d4d456 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:5858:1875537627710720:0@lo:502: 00000020:01000000:0.0:1788652138.702537:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788652138.702542:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652138.702544:0:5858:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1788652138.702547:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788652138.702819:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788652138.702836:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788652138.702861:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 00000000c6622332/0x340ed74ef02a7280 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7287 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.702872:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: 00000000c6622332/0x340ed74ef02a7280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7287 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652138.702880:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbe50c46000 from 1 10000000:01000000:2.0:1788652138.702883:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788652138.702922:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 00000000f10f3f99/0x340ed74ef02a72d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.702935:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 00000000f10f3f99/0x340ed74ef02a72d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.702944:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 00000000f10f3f99/0x340ed74ef02a72d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652138.702958:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7b1de9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627710848:0@lo:101: 00000100:00100000:2.0:1788652138.702987:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652138.703002:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 000000003c5bfee3 going to sleep for 11 seconds 00000100:00100000:0.0:1788652138.703387:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627710848 00000100:00100000:0.0:1788652138.703394:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627710848 00000100:00100000:0.0:1788652138.703427:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788652138.703440:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b48f984 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+9:5812:x1875537627710848:12345-0@lo:101: 00010000:00010000:0.0:1788652138.703451:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652138.703466:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000083731dfd/0x340ed74ef02a72db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a72d4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652138.703488:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000083731dfd/0x340ed74ef02a72db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a72d4 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652138.703496:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000083731dfd/0x340ed74ef02a72db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a72d4 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652138.703505:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000083731dfd, rc 0) 00000100:00100000:0.0:1788652138.703538:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b48f984 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+10:5812:x1875537627710848:12345-0@lo:101: Request processed in 99us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652138.703544:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788652138.703919:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7b1de9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627710848:0@lo:101: 00010000:00010000:2.0:1788652138.703937:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 00000000f10f3f99/0x340ed74ef02a72d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a72db expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.703945:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 00000000f10f3f99/0x340ed74ef02a72d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a72db expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652138.705495:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7b1de9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627710976:0@lo:256: 00000100:00100000:2.0:1788652138.705562:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652138.705596:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627710976 00000100:00100000:2.0:1788652138.705597:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 000000003c5bfee3 going to sleep for 11 seconds 00000100:00100000:3.0:1788652138.705604:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627710976 00000100:00100000:3.0:1788652138.705654:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788652138.705662:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004722c546 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+10:5812:x1875537627710976:12345-0@lo:256: 20000000:01000000:3.0:1788652138.705679:0:5829:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788652138.705685:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788652138.705764:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004722c546 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+10:5812:x1875537627710976:12345-0@lo:256: Request processed in 103us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652138.705790:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788652138.706468:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7b1de9e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627710976:0@lo:256: 10000000:01000000:2.0:1788652138.707525:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788652138.707598:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 00000000f10f3f99/0x340ed74ef02a72d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a72db expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.707610:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: 00000000f10f3f99/0x340ed74ef02a72d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a72db expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652138.707694:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe50c46000 from 1 10000000:01000000:0.0:1788652138.707698:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788652138.707738:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 00000000f32e0c4d/0x340ed74ef02a72e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652138.707746:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 00000000f32e0c4d/0x340ed74ef02a72e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652138.707755:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 00000000f32e0c4d/0x340ed74ef02a72e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652138.707802:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036d4d456 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627711104:0@lo:101: 00000100:00100000:0.0:1788652138.707871:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652138.707909:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e76dccd9 going to sleep for 11 seconds 00000100:00100000:2.0:1788652138.707978:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627711104 00000100:00100000:2.0:1788652138.707985:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627711104 00000100:00100000:2.0:1788652138.708033:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788652138.708041:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090ee33e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+10:5812:x1875537627711104:12345-0@lo:101: 00010000:00010000:2.0:1788652138.708051:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652138.708064:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000045faf66f/0x340ed74ef02a72e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a72e2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.708085:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000045faf66f/0x340ed74ef02a72e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a72e2 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.708093:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000045faf66f/0x340ed74ef02a72e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a72e2 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.708101:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000045faf66f, rc 0) 00000100:00100000:2.0:1788652138.708135:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090ee33e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+11:5812:x1875537627711104:12345-0@lo:101: Request processed in 95us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652138.708140:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788652138.708541:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036d4d456 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627711104:0@lo:101: 00010000:00010000:0.0:1788652138.708564:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 00000000f32e0c4d/0x340ed74ef02a72e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a72e9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652138.708571:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 00000000f32e0c4d/0x340ed74ef02a72e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a72e9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652138.708621:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036d4d456 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627711232:0@lo:501: 00000100:00100000:0.0:1788652138.708654:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652138.708676:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e76dccd9 going to sleep for 11 seconds 00000100:00100000:1.0:1788652138.708940:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627711232 00000100:00100000:1.0:1788652138.708946:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627711232 00000100:00100000:1.0:1788652138.709021:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788652138.709029:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6eef8e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+11:5812:x1875537627711232:12345-0@lo:501: 00000100:00100000:1.0:1788652138.709680:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6eef8e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+11:5812:x1875537627711232:12345-0@lo:501: Request processed in 651us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652138.709688:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788652138.709703:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036d4d456 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627711232:0@lo:501: 00000100:00100000:0.0:1788652138.709736:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036d4d456 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627711360:0@lo:503: 00000100:00100000:0.0:1788652138.709797:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652138.709838:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e76dccd9 going to sleep for 11 seconds 00000100:00100000:3.0:1788652138.709854:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627711360 00000100:00100000:3.0:1788652138.709859:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627711360 00000100:00100000:3.0:1788652138.710604:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788652138.710617:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007760a0f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+11:5812:x1875537627711360:12345-0@lo:503: 00000040:00080000:3.0:1788652138.711103:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788652138.711177:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007760a0f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+11:5812:x1875537627711360:12345-0@lo:503: Request processed in 564us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652138.711186:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788652138.711283:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036d4d456 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627711360:0@lo:503: 00000040:00080000:2.0:1788652138.712590:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788652138.712733:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788652138.712755:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788652138.712965:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 00000000f32e0c4d/0x340ed74ef02a72e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a72e9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652138.712977:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: 00000000f32e0c4d/0x340ed74ef02a72e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a72e9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652138.713023:0:5812:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788652138.713026:0:5812:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cbe50c46000 10000000:01000000:0.0:1788652138.713028:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cbe50c46000 10000000:01000000:0.0:1788652138.713032:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788652138.713037:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbe50c46000 from 1 10000000:01000000:0.0:1788652138.713040:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788652138.713076:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 00000000d0672c2c/0x340ed74ef02a72f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652138.713082:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 00000000d0672c2c/0x340ed74ef02a72f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652138.713091:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 00000000d0672c2c/0x340ed74ef02a72f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652138.713109:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036d4d456 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627711488:0@lo:101: 00000100:00100000:0.0:1788652138.713158:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652138.713187:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 00000000076b4275 going to sleep for 11 seconds 00000100:00100000:2.0:1788652138.713233:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627711488 00000100:00100000:2.0:1788652138.713241:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627711488 00000100:00100000:2.0:1788652138.713282:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788652138.713289:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f741d22a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+11:5812:x1875537627711488:12345-0@lo:101: 00010000:00010000:2.0:1788652138.713307:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652138.713323:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a58c37e8/0x340ed74ef02a72f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a72f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.713342:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a58c37e8/0x340ed74ef02a72f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a72f0 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.713358:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a58c37e8/0x340ed74ef02a72f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a72f0 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.713366:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a58c37e8, rc 0) 00000100:00100000:2.0:1788652138.713402:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f741d22a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+12:5812:x1875537627711488:12345-0@lo:101: Request processed in 114us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652138.713408:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788652138.713532:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036d4d456 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627711488:0@lo:101: 00010000:00010000:0.0:1788652138.713543:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 00000000d0672c2c/0x340ed74ef02a72f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a72f7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652138.713551:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 00000000d0672c2c/0x340ed74ef02a72f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a72f7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652138.713590:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036d4d456 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627711616:0@lo:501: 00000100:00100000:0.0:1788652138.713610:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652138.713628:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 00000000076b4275 going to sleep for 11 seconds 00000100:00100000:3.0:1788652138.713675:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627711616 00000100:00100000:3.0:1788652138.713679:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627711616 00000100:00100000:3.0:1788652138.713709:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788652138.713714:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007505bcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:5812:x1875537627711616:12345-0@lo:501: 00000100:00100000:3.0:1788652138.713933:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007505bcb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:5812:x1875537627711616:12345-0@lo:501: Request processed in 217us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652138.713940:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788652138.714072:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036d4d456 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627711616:0@lo:501: 00000100:00100000:0.0:1788652138.714095:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036d4d456 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627711744:0@lo:503: 00000100:00100000:0.0:1788652138.714126:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652138.714150:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 00000000076b4275 going to sleep for 11 seconds 00000100:00100000:2.0:1788652138.714265:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627711744 00000100:00100000:2.0:1788652138.714270:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627711744 00000100:00100000:2.0:1788652138.714302:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788652138.714308:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bcb7e20a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+12:5812:x1875537627711744:12345-0@lo:503: 00000100:00100000:2.0:1788652138.714595:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bcb7e20a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+12:5812:x1875537627711744:12345-0@lo:503: Request processed in 287us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652138.714603:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788652138.714763:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036d4d456 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627711744:0@lo:503: 00000100:00100000:3.0:1788652138.715718:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a19b2d01 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:5863:1875537627711872:0@lo:502: 00000100:00100000:3.0:1788652138.715801:0:5863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652138.715845:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set 0000000031516c35 going to sleep for 11 seconds 00000100:00100000:2.0:1788652138.716064:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627711872 00000100:00100000:2.0:1788652138.716070:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627711872 00000100:00100000:2.0:1788652138.716105:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788652138.716113:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032e6a35b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+12:5863:x1875537627711872:12345-0@lo:502: 00000100:00100000:2.0:1788652138.716438:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032e6a35b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+12:5863:x1875537627711872:12345-0@lo:502: Request processed in 326us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652138.716446:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788652138.716659:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a19b2d01 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:5863:1875537627711872:0@lo:502: 00000020:01000004:3.0:1788652138.716716:0:5863:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788652138.716730:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000001f3b2456) 00000020:00000080:3.0:1788652138.716747:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788652138.716981:0:5863:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b6fa4e50 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788652138.716985:0:5863:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000b6fa4e50 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788652138.716987:0:5863:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000b6fa4e50 4 00010000:00080000:3.0:1788652138.717013:0:5863:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000010574a10@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.150@tcp at head 00010000:00010000:3.0:1788652138.719948:0:5863:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788652138.720146:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788652138.720190:0:5863:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788652138.720203:0:5863:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x340ed74ef02a7305 00000100:00080000:3.0:1788652138.720213:0:5863:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788652138.720218:0:5863:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000010574a10 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1788652138.720251:0:5863:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a19b2d01 x1875537627712000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788652138.720286:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a19b2d01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875537627712000:0@lo:38: 00000100:00080000:2.0:1788652138.721581:0:5863:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788652138.721920:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7b1de9e pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:5863:1875537627712128:0@lo:502: 00000100:00100000:2.0:1788652138.727448:0:5863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652138.727492:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627712128 00000100:00100000:2.0:1788652138.727500:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627712128 00000100:00100000:2.0:1788652138.727554:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788652138.727562:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5818cb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:5863:x1875537627712128:12345-0@lo:502: 00000100:00100000:2.0:1788652138.727861:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5818cb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:5863:x1875537627712128:12345-0@lo:502: Request processed in 300us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652138.727869:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788652138.727929:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017cd3ac7 going to sleep for 11 seconds 00000100:00100000:2.0:1788652138.727950:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7b1de9e pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:5863:1875537627712128:0@lo:502: 00000040:00080000:2.0:1788652138.727984:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:3.0:1788652138.728472:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652138.728556:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627712000 00000100:00100000:2.0:1788652138.728563:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627712000 00000100:00100000:2.0:1788652138.728593:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788652138.728598:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1c9e82d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1875537627712000:12345-0@lo:38: 00000100:00100000:2.0:1788652138.728658:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1c9e82d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1875537627712000:12345-0@lo:38: Request processed in 59us (187us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788652138.728665:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788652138.728723:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788652138.728738:0:3302:0:(import.c:65:import_set_state_nolock()) 0000000010574a10 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788652138.728743:0:3302:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788652138.728746:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a19b2d01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875537627712000:0@lo:38: 00000020:01000000:1.0:1788652138.728958:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788652138.728981:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788652138.729034:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 00000000d0672c2c/0x340ed74ef02a72f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a72f7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652138.729045:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: 00000000d0672c2c/0x340ed74ef02a72f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a72f7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788652138.729347:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788652138.729350:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788652138.729352:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788652138.729353:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788652138.729354:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788652138.729355:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788652138.729357:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788652138.729358:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788652138.729360:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788652138.729361:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788652138.729362:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788652138.729363:0:5812:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788652138.729367:0:5812:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788652138.729369:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788652138.729370:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788652138.729371:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788652138.729372:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788652138.729372:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788652138.729373:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788652138.729374:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788652138.729375:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788652138.729376:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788652138.729377:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788652138.729377:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788652138.729378:0:5812:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788652138.729400:0:5812:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788652138.729415:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036d4d456 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627712256:0@lo:253: 00000100:00100000:0.0:1788652138.729466:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652138.729500:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b9746f57 going to sleep for 11 seconds 00000100:00100000:1.0:1788652138.729606:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627712256 00000100:00100000:1.0:1788652138.729611:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627712256 00000100:00100000:1.0:1788652138.729664:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788652138.729672:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000532de7d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+12:5812:x1875537627712256:12345-0@lo:253: 20000000:01000000:1.0:1788652138.729698:0:5830:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788652138.729710:0:5830:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:2.0:1788652138.762577:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:1.0:1788652138.803724:0:5830:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788652138.803919:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788652138.806610:0:5851:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788652138.806619:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788652138.806652:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000eb196199/0x340ed74ef02a730c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652138.806670:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000083731dfd/0x340ed74ef02a72db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a72d4 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652138.806678:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000eb196199/0x340ed74ef02a730c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652138.806719:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000083731dfd/0x340ed74ef02a72db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a72d4 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652138.806735:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000083731dfd/0x340ed74ef02a72db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a72d4 expref: 12 pid: 5830 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652138.806749:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e001e8a1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1875537627712384:0@lo:104: 00000100:00100000:3.0:1788652138.806832:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652138.806890:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set 0000000031516c35 going to sleep for 11 seconds 00000100:00100000:0.0:1788652138.807464:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627712384 00000100:00100000:0.0:1788652138.807474:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627712384 00000100:00100000:0.0:1788652138.807525:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788652138.807533:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3bacfd5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f811a652-691e-4a40-b660-977a4758dd08+3:5851:x1875537627712384:12345-0@lo:104: 00010000:00010000:0.0:1788652138.807559:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: 00000000f10f3f99/0x340ed74ef02a72d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a72db expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652138.807647:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788652138.807653:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3bacfd5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f811a652-691e-4a40-b660-977a4758dd08+3:5851:x1875537627712384:12345-0@lo:104: Request processed in 121us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652138.807660:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788652138.808100:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e001e8a1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1875537627712384:0@lo:104: 00010000:00010000:1.0:1788652138.808122:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000eb196199/0x340ed74ef02a730c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.808468:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652138.808475:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: 00000000f10f3f99/0x340ed74ef02a72d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a72db expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.808483:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f10f3f99 already unused, calling callback (000000003fd92918) 10000000:00010000:2.0:1788652138.808486:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: 00000000f10f3f99/0x340ed74ef02a72d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a72db expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.808494:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: 00000000f10f3f99/0x340ed74ef02a72d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a72db expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652138.808501:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: 00000000f10f3f99/0x340ed74ef02a72d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a72db expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652138.808518:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788652138.808559:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: 00000000f10f3f99/0x340ed74ef02a72d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a72db expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.808566:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652138.808589:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: 00000000f10f3f99/0x340ed74ef02a72d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a72db expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.808596:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: 00000000f10f3f99/0x340ed74ef02a72d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a72db expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.808612:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652138.808613:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652138.808614:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652138.808722:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7b1de9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627712512:0@lo:103: 00000100:00100000:0.0:1788652138.808862:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652138.809423:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627712512 00000100:00100000:2.0:1788652138.809430:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627712512 00010000:00010000:2.0:1788652138.809452:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000083731dfd/0x340ed74ef02a72db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a72d4 expref: 13 pid: 5830 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652138.809478:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788652138.809486:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000680cef65 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f811a652-691e-4a40-b660-977a4758dd08+13:3304:x1875537627712512:12345-0@lo:103: 00010000:00010000:2.0:1788652138.809497:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652138.809501:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000083731dfd/0x340ed74ef02a72db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a72d4 expref: 13 pid: 5830 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.809510:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000083731dfd/0x340ed74ef02a72db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a72d4 expref: 13 pid: 5830 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.809524:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000083731dfd/0x340ed74ef02a72db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a72d4 expref: 13 pid: 5830 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.809545:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000eb196199/0x340ed74ef02a730c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.809552:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eb196199/0x340ed74ef02a730c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788652138.809566:0:5820:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002947561s 00010000:00010000:2.0:1788652138.809570:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000eb196199/0x340ed74ef02a730c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.809575:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000eb196199/0x340ed74ef02a730c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.809581:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000eb196199/0x340ed74ef02a730c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.809586:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000eb196199/0x340ed74ef02a730c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.809591:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eb196199 already unused, calling callback (0000000062669929) 00010000:00010000:2.0:1788652138.809594:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000eb196199/0x340ed74ef02a730c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.809600:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000eb196199/0x340ed74ef02a730c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.809616:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000eb196199/0x340ed74ef02a730c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.809625:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652138.809679:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000680cef65 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f811a652-691e-4a40-b660-977a4758dd08+12:3304:x1875537627712512:12345-0@lo:103: Request processed in 194us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652138.809687:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788652138.809719:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7b1de9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627712512:0@lo:103: 00010000:00010000:1.0:1788652138.816440:0:5851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000eb196199/0x340ed74ef02a730c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652138.816458:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000eb196199/0x340ed74ef02a730c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652138.816464:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000eb196199/0x340ed74ef02a730c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652138.833954:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000532de7d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+11:5812:x1875537627712256:12345-0@lo:253: Request processed in 104275us (104480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652138.833970:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788652138.834284:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036d4d456 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:5812:1875537627712256:0@lo:253: 10000000:01000000:0.0:1788652138.834302:0:5812:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788652138.834305:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788652138.834308:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788652138.834309:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788652138.834310:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788652138.834312:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788652138.834313:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788652138.834314:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788652138.834316:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788652138.834317:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788652138.834318:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788652138.834320:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788652138.834321:0:5812:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788652138.834339:0:5812:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788652138.851969:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788652138.852683:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788652138.852955:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788652138.853625:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788652138.853940:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788652138.854157:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788652138.861932:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788652138.863537:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788652138.863844:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788652138.864847:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788652138.865122:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788652138.865294:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1788652138.969128:0:5812:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788652139.047288:0:5812:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788652139.047584:0:5869:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1788652139.050380:0:5868:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788652139.050387:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788652139.050949:0:5812:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788652139.051110:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788652139.051697:0:5812:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788652139.051706:0:5812:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788652139.052100:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788652139.058763:0:5812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788652139.061102:0:5812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788652139.061188:0:5812:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788652139.061735:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788652139.062975:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788652139.069543:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788652139.075741:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788652139.075993:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788652139.076145:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788652139.078705:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788652139.078949:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788652139.079095:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788652139.079280:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788652139.082515:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788652139.082746:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788652139.082914:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788652139.083070:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788652139.083215:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788652139.084466:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788652139.084653:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788652139.084801:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788652139.095280:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788652139.096488:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788652139.096725:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788652139.096890:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788652139.097740:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788652139.098086:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788652139.098258:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788652139.098417:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788652139.099861:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788652139.100664:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788652139.102565:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788652139.102862:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788652139.106097:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788652139.106361:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788652139.106677:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788652139.107394:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788652139.107733:0:5812:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1788652139.144043:0:5869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1788652139.215303:0:5812:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788652139.215337:0:5812:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa2468198b988 00100000:10000000:1.0:1788652139.215345:0:5812:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788652139.216601:0:5812:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788652139.216617:0:5812:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.150@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788652139.216642:0:5812:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788652139.216677:0:5812:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1788652139.310392:0:5869:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788652139.310497:0:5869:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788652139.310502:0:5869:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1788652139.788119:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652140.808079:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652141.832089:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652142.858860:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788652143.751899:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788652143.751911:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788652143.751913:0:36:0:(import.c:65:import_set_state_nolock()) 0000000010574a10 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788652143.751926:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000010574a10 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1788652143.751949:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a8ab5af9 x1875537627712768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788652143.752010:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a8ab5af9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875537627712768:0@lo:38: 00000100:00100000:0.0:1788652143.752075:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652143.752112:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627712768 00000100:00100000:3.0:1788652143.752122:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627712768 00000100:00100000:3.0:1788652143.752171:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788652143.752178:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052fbd111 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1875537627712768:12345-0@lo:38: 00010000:00080000:3.0:1788652143.752202:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:3.0:1788652143.752239:0:5837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x340ed74ef02a7313 00000004:00100000:3.0:1788652143.752282:0:5837:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788652143.752391:0:5837:0:(import.c:65:import_set_state_nolock()) 00000000b83c1d36 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788652143.752448:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052fbd111 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875537627712768:12345-0@lo:38: Request processed in 268us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652143.752457:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788652143.752531:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a8ab5af9 x1875537627712768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788652153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788652143.752545:0:3302:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788652143.752552:0:3302:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788652143.752557:0:3302:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788652143.752559:0:3302:0:(import.c:65:import_set_state_nolock()) 0000000010574a10 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788652143.752571:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a8ab5af9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875537627712768:0@lo:38: 00000100:00100000:2.0:1788652143.757273:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000036d4d456 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627712640:0@lo:400: 00000100:00100000:2.0:1788652143.757351:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652143.759300:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627712640 00000100:00100000:3.0:1788652143.759313:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627712640 00000100:00100000:3.0:1788652143.759373:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788652143.759382:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015a69303 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+11:3305:x1875537627712640:12345-0@lo:400: 00000100:00100000:3.0:1788652143.759459:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015a69303 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+11:3305:x1875537627712640:12345-0@lo:400: Request processed in 79us (2108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652143.759479:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788652143.759538:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000036d4d456 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627712640:0@lo:400: 00010000:00010000:0.0:1788652143.881803:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788652144.264090:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788652144.264098:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbe50c46000 from 3 10000000:01000000:3.0:1788652144.264112:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788652144.264154:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 00000000550c93c7/0x340ed74ef02a731a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652144.264166:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 00000000550c93c7/0x340ed74ef02a731a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652144.264176:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 00000000550c93c7/0x340ed74ef02a731a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652144.264198:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000014bac331 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627712896:0@lo:101: 00000100:00100000:3.0:1788652144.264262:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652144.264302:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 000000008d7af76a going to sleep for 11 seconds 00000100:00100000:1.0:1788652144.264991:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627712896 00000100:00100000:1.0:1788652144.265001:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627712896 00000100:00100000:1.0:1788652144.265200:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788652144.265210:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c673d2bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+11:5832:x1875537627712896:12345-0@lo:101: 00010000:00010000:1.0:1788652144.265224:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652144.265238:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000645f7acb/0x340ed74ef02a7321 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a731a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652144.265260:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000645f7acb/0x340ed74ef02a7321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a731a expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652144.265270:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000645f7acb/0x340ed74ef02a7321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a731a expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652144.265280:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000645f7acb, rc 0) 00000100:00100000:1.0:1788652144.265330:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c673d2bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+12:5832:x1875537627712896:12345-0@lo:101: Request processed in 123us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652144.265336:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788652144.265379:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000014bac331 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627712896:0@lo:101: 00010000:00010000:1.0:1788652144.265392:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 00000000550c93c7/0x340ed74ef02a731a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7321 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652144.265409:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 00000000550c93c7/0x340ed74ef02a731a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a7321 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652144.265455:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000183da19d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627713024:0@lo:256: 00000100:00100000:1.0:1788652144.265483:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652144.265503:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 000000006731307e going to sleep for 11 seconds 00000100:00100000:1.0:1788652144.265515:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627713024 00000100:00100000:1.0:1788652144.265518:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627713024 00000100:00100000:1.0:1788652144.265537:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788652144.265542:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a51216c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:5832:x1875537627713024:12345-0@lo:256: 20000000:01000000:1.0:1788652144.265553:0:5829:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788652144.265566:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788652144.265569:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788652144.265644:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a51216c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:5832:x1875537627713024:12345-0@lo:256: Request processed in 102us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652144.265650:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788652144.268920:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000183da19d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627713024:0@lo:256: 10000000:01000000:1.0:1788652144.268991:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788652144.269002:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: 00000000550c93c7/0x340ed74ef02a731a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7321 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652144.269012:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: 00000000550c93c7/0x340ed74ef02a731a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7321 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:1.0:1788652144.586096:0:6112:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788652144.907709:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652145.928001:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652146.952766:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652147.979662:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652148.873881:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000183da19d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627713152:0@lo:400: 00000100:00100000:1.0:1788652148.874001:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652148.874107:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000015f3291b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627713280:0@lo:400: 00000100:00100000:1.0:1788652148.874562:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652148.874636:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627713152 00000100:00100000:1.0:1788652148.874646:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627713152 00000100:00100000:3.0:1788652148.874679:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627713280 00000100:00100000:3.0:1788652148.874686:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627713280 00000100:00100000:1.0:1788652148.874719:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788652148.874730:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788652148.874738:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a84d24f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627713280:12345-0@lo:400: 00000100:00100000:1.0:1788652148.874743:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000927baf99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:3306:x1875537627713152:12345-0@lo:400: 00000100:00100000:1.0:1788652148.874839:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000927baf99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:3306:x1875537627713152:12345-0@lo:400: Request processed in 110us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652148.874846:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a84d24f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627713280:12345-0@lo:400: Request processed in 108us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652148.874852:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788652148.874860:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788652148.874923:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000183da19d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627713152:0@lo:400: 00010000:00080000:1.0:1788652148.874961:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000015f3291b x1875537627713280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652148.874974:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000015f3291b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627713280:0@lo:400: 00010000:00010000:2.0:1788652149.002645:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788652149.953926:0:6313:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa2459e00 20000000:00000080:0.0:1788652149.953948:0:6313:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cbe4a60d400 uarg=0000000000000000 20000000:01000000:0.0:1788652149.953990:0:6313:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788652149.953998:0:6313:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788652149.954004:0:6313:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788652149.954258:0:6313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788652149.954271:0:6313:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788652149.960886:0:6313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788652149.961224:0:6313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788652149.961288:0:6313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788652149.961344:0:6313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788652149.961363:0:6313:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788652149.961385:0:6313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a50701b0/0x340ed74ef02a7328 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652149.961407:0:6313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000045faf66f/0x340ed74ef02a72e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a72e2 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652149.961416:0:6313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a50701b0/0x340ed74ef02a7328 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652149.961467:0:6313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000045faf66f/0x340ed74ef02a72e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a72e2 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652149.961485:0:6313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000045faf66f/0x340ed74ef02a72e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a72e2 expref: 11 pid: 5828 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652149.961502:0:6313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a8ab5af9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6313:1875537627713408:0@lo:104: 00000100:00100000:0.0:1788652149.962287:0:6313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652149.962376:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627713408 00000100:00100000:0.0:1788652149.962385:0:6313:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ff89a550 going to sleep for 11 seconds 00000100:00100000:3.0:1788652149.962388:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627713408 00000100:00100000:3.0:1788652149.962465:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788652149.962476:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004345fe6d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+3:6313:x1875537627713408:12345-0@lo:104: 00010000:00010000:3.0:1788652149.962503:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: 00000000f32e0c4d/0x340ed74ef02a72e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a72e9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652149.962600:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788652149.962607:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004345fe6d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+3:6313:x1875537627713408:12345-0@lo:104: Request processed in 134us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652149.962615:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788652149.962639:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652149.962646:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: 00000000f32e0c4d/0x340ed74ef02a72e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a72e9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652149.962756:0:6313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a8ab5af9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6313:1875537627713408:0@lo:104: 00010000:00010000:2.0:1788652149.962799:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f32e0c4d already unused, calling callback (000000003fd92918) 10000000:00010000:2.0:1788652149.962804:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: 00000000f32e0c4d/0x340ed74ef02a72e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a72e9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652149.962813:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: 00000000f32e0c4d/0x340ed74ef02a72e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a72e9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652149.962820:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: 00000000f32e0c4d/0x340ed74ef02a72e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a72e9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652149.962826:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788652149.962826:0:6313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a50701b0/0x340ed74ef02a7328 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652149.962883:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: 00000000f32e0c4d/0x340ed74ef02a72e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a72e9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652149.962901:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652149.962946:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: 00000000f32e0c4d/0x340ed74ef02a72e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a72e9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652149.962954:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: 00000000f32e0c4d/0x340ed74ef02a72e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a72e9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652149.962974:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652149.962977:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652149.962979:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652149.962998:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7b1de9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627713536:0@lo:103: 00000100:00100000:1.0:1788652149.963041:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652149.963310:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627713536 00000100:00100000:2.0:1788652149.963316:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627713536 00010000:00010000:2.0:1788652149.963345:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000045faf66f/0x340ed74ef02a72e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a72e2 expref: 12 pid: 5828 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652149.963376:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788652149.963384:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015f3291b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f811a652-691e-4a40-b660-977a4758dd08+12:3304:x1875537627713536:12345-0@lo:103: 00010000:00010000:2.0:1788652149.963397:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652149.963403:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000045faf66f/0x340ed74ef02a72e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a72e2 expref: 12 pid: 5828 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652149.963425:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000045faf66f/0x340ed74ef02a72e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a72e2 expref: 12 pid: 5828 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652149.963440:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000045faf66f/0x340ed74ef02a72e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a72e2 expref: 12 pid: 5828 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652149.963456:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a50701b0/0x340ed74ef02a7328 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652149.963477:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a50701b0/0x340ed74ef02a7328 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652149.963493:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a50701b0/0x340ed74ef02a7328 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652149.963501:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a50701b0/0x340ed74ef02a7328 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652149.963630:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a50701b0/0x340ed74ef02a7328 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652149.963637:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a50701b0/0x340ed74ef02a7328 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652149.963643:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a50701b0 already unused, calling callback (0000000062669929) 00010000:00010000:2.0:1788652149.963647:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a50701b0/0x340ed74ef02a7328 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652149.963809:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a50701b0/0x340ed74ef02a7328 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652149.963823:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a50701b0/0x340ed74ef02a7328 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652149.963835:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788652149.963855:0:6313:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a50701b0/0x340ed74ef02a7328 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652149.963866:0:6313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a50701b0/0x340ed74ef02a7328 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652149.963873:0:6313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a50701b0/0x340ed74ef02a7328 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652149.963886:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015f3291b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f811a652-691e-4a40-b660-977a4758dd08+11:3304:x1875537627713536:12345-0@lo:103: Request processed in 502us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652149.963894:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788652149.964950:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7b1de9e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627713536:0@lo:103: 00010000:00010000:0.0:1788652150.027246:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652151.048130:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652152.073019:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788652152.336417:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788652152.336426:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe50c46000 from 1 10000000:01000000:0.0:1788652152.336431:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788652152.336488:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: 00000000b3d028b8/0x340ed74ef02a732f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652152.336503:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: 00000000b3d028b8/0x340ed74ef02a732f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652152.336515:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: 00000000b3d028b8/0x340ed74ef02a732f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652152.336542:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a8ab5af9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627713664:0@lo:101: 00000100:00100000:0.0:1788652152.336634:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652152.336701:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627713664 00000100:00100000:0.0:1788652152.336710:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627713664 00000100:00100000:0.0:1788652152.336765:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788652152.336792:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004eed6148 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+11:5832:x1875537627713664:12345-0@lo:101: 00010000:00010000:0.0:1788652152.336809:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652152.336822:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002f2af19c/0x340ed74ef02a7336 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a732f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652152.336849:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002f2af19c/0x340ed74ef02a7336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a732f expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652152.336862:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002f2af19c/0x340ed74ef02a7336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a732f expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652152.336873:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002f2af19c, rc 0) 00000100:00100000:0.0:1788652152.336909:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004eed6148 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+12:5832:x1875537627713664:12345-0@lo:101: Request processed in 119us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652152.336916:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788652152.336977:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 0000000089cc7005 going to sleep for 11 seconds 00000100:00100000:0.0:1788652152.337004:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a8ab5af9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627713664:0@lo:101: 00010000:00010000:0.0:1788652152.337021:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: 00000000b3d028b8/0x340ed74ef02a732f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7336 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652152.337031:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: 00000000b3d028b8/0x340ed74ef02a732f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a7336 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652152.337092:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a8ab5af9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627713792:0@lo:501: 00000100:00100000:0.0:1788652152.337117:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652152.337138:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627713792 00000100:00100000:0.0:1788652152.337148:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627713792 00000100:00100000:0.0:1788652152.337172:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788652152.337178:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be260a37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+12:5832:x1875537627713792:12345-0@lo:501: 00000100:00100000:1.0:1788652152.337897:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 0000000089cc7005 going to sleep for 11 seconds 00000100:00100000:0.0:1788652152.338488:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be260a37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+12:5832:x1875537627713792:12345-0@lo:501: Request processed in 1307us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652152.338499:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788652152.338963:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a8ab5af9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627713792:0@lo:501: 00000100:00100000:1.0:1788652152.339023:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000183da19d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627713920:0@lo:503: 00000100:00100000:1.0:1788652152.339073:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652152.339097:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef978386 going to sleep for 11 seconds 00000100:00100000:0.0:1788652152.339149:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627713920 00000100:00100000:0.0:1788652152.339157:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627713920 00000100:00100000:0.0:1788652152.339208:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788652152.339216:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee148561 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:5832:x1875537627713920:12345-0@lo:503: 00000100:00100000:0.0:1788652152.339586:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee148561 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:5832:x1875537627713920:12345-0@lo:503: Request processed in 369us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652152.339594:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788652152.339710:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000183da19d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627713920:0@lo:503: 00000100:00100000:1.0:1788652152.340067:0:6387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000bc57da0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:6387:1875537627714048:0@lo:502: 00000100:00100000:1.0:1788652152.340105:0:6387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652152.340134:0:6387:0:(client.c:2716:ptlrpc_set_wait()) set 000000003bdfd6b2 going to sleep for 11 seconds 00000100:00100000:0.0:1788652152.340179:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627714048 00000100:00100000:0.0:1788652152.340191:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627714048 00000100:00100000:0.0:1788652152.340224:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788652152.340231:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fbba564 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+12:6387:x1875537627714048:12345-0@lo:502: 00000100:00100000:0.0:1788652152.340564:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fbba564 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+12:6387:x1875537627714048:12345-0@lo:502: Request processed in 333us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652152.340572:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788652152.340646:0:6387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000bc57da0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:6387:1875537627714048:0@lo:502: 00000020:01000000:1.0:1788652152.340670:0:6387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788652152.340682:0:6387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652152.340685:0:6387:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788652152.340695:0:6387:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbe50c46000 00000020:00000080:1.0:1788652152.340699:0:6387:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788652152.340744:0:6387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b192680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:6387:1875537627714176:0@lo:502: 00000100:00100000:1.0:1788652152.340806:0:6387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652152.340827:0:6387:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe42cf2780 going to sleep for 11 seconds 00000100:00100000:0.0:1788652152.340916:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627714176 00000100:00100000:0.0:1788652152.340921:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627714176 00000100:00100000:0.0:1788652152.340949:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788652152.340956:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+12:6387:x1875537627714176:12345-0@lo:502: 00000100:00100000:0.0:1788652152.341069:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+12:6387:x1875537627714176:12345-0@lo:502: Request processed in 112us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652152.341075:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788652152.341157:0:6387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b192680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:6387:1875537627714176:0@lo:502: 00000020:01000000:3.0:1788652152.341174:0:6387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652152.341179:0:6387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652152.341181:0:6387:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788652152.341196:0:6387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788652152.341579:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788652152.341602:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788652152.341613:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a732f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7336 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652152.341627:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a732f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7336 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652153.096084:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652153.995926:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875537627714432:0@lo:400: 00000100:00100000:2.0:1788652153.995999:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652153.996065:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788652153.996071:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627714304:0@lo:400: 00000100:00100000:2.0:1788652153.996100:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652153.996137:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627714432 00000100:00100000:2.0:1788652153.996144:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627714432 00000100:00100000:2.0:1788652153.996193:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788652153.996202:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875537627714432:12345-0@lo:400: 00000100:00100000:2.0:1788652153.996257:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875537627714432:12345-0@lo:400: Request processed in 57us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652153.996264:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788652153.996284:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627714304 00000100:00100000:2.0:1788652153.996287:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627714304 00000100:00100000:2.0:1788652153.996307:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788652153.996313:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+12:3306:x1875537627714304:12345-0@lo:400: 00000100:00100000:2.0:1788652153.996338:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+12:3306:x1875537627714304:12345-0@lo:400: Request processed in 26us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652153.996344:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788652153.996394:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627714304:0@lo:400: 00010000:00080000:2.0:1788652153.996407:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cbe759abb80 x1875537627714432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652153.996418:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875537627714432:0@lo:400: 00010000:00010000:2.0:1788652154.120977:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652155.149798:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652156.168013:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788652157.061390:0:6675:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788652157.061394:0:6675:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788652157.061542:0:6675:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cbe818bc800 00000020:01000004:0.0:1788652157.061561:0:6675:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788652157.061573:0:6675:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788652157.061587:0:6675:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8cbe4b173380) 00000020:00000080:0.0:1788652157.061604:0:6675:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788652157.081600:0:6675:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788652157.082356:0:6675:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788652157.106384:0:6675:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788652157.113992:0:6675:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788652157.114035:0:6675:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788652157.114176:0:6675:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788652157.114204:0:6675:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788652157.114544:0:6675:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788652157.114556:0:6675:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788652157.114567:0:6675:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x340ed74ef02a7344 00000020:01000004:2.0:1788652157.114575:0:6675:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788652157.114813:0:6675:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.150@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788652157.114818:0:6675:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788652157.114824:0:6675:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788652157.114829:0:6675:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788652157.114852:0:6675:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8cbe513c3380) 00000020:00000080:2.0:1788652157.114864:0:6675:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788652157.117588:0:6675:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788652157.119961:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788652157.123506:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788652157.128244:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788652157.128260:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788652157.128765:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788652157.128807:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788652157.131039:0:6675:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788652157.131322:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788652157.131328:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788652157.132997:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788652157.133008:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788652157.171665:0:6675:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788652157.172706:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788652157.172715:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788652157.176140:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788652157.176157:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788652157.185698:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788652157.185716:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00010000:00010000:0.0:1788652157.192939:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652157.194880:0:6675:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788652157.195276:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788652157.195293:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788652157.196801:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788652157.196813:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788652157.285570:0:6675:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788652157.285804:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788652157.285810:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788652157.290813:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788652157.290830:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788652157.291452:0:6675:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788652157.291480:0:6675:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788652157.291486:0:6675:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.150@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788652157.336706:0:6675:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.150@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788652157.337222:0:6675:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.150@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788652157.337227:0:6675:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788652157.337229:0:6675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788652157.337235:0:6675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788652157.337236:0:6675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788652157.337238:0:6675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788652157.337239:0:6675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788652157.337240:0:6675:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788652157.337241:0:6675:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788652157.337243:0:6675:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788652157.337244:0:6675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788652157.337245:0:6675:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788652157.337249:0:6675:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788652157.337251:0:6675:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788652157.337252:0:6675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788652157.337253:0:6675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788652157.337254:0:6675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788652157.337254:0:6675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788652157.337255:0:6675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788652157.337256:0:6675:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788652157.337257:0:6675:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788652157.337258:0:6675:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788652157.337259:0:6675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788652157.337260:0:6675:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788652157.337286:0:6675:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788652157.337305:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627714560:0@lo:253: 00000100:00100000:2.0:1788652157.337439:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652157.337550:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe434c8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788652157.340370:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627714560 00000100:00100000:1.0:1788652157.340390:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627714560 00000100:00100000:1.0:1788652157.340467:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788652157.340479:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:6675:x1875537627714560:12345-0@lo:253: 20000000:01000000:1.0:1788652157.340523:0:5829:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788652157.340528:0:5829:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788652157.340581:0:5829:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788652157.340586:0:5829:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788652157.342858:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788652157.343149:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788652157.343166:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788652157.343210:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1788652157.343218:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788652157.343249:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788652157.343300:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788652157.344618:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788652157.344649:0:5829:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.150@tcp 20000000:01000000:1.0:1788652157.344652:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.150@tcp (null) (null) (null) 00000040:00080000:1.0:1788652157.344690:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788652157.344747:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788652157.344907:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788652157.344934:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.150@tcp (null) (null) 00000040:00080000:1.0:1788652157.344970:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788652157.344980:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788652157.345572:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788652157.346185:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1788652157.349578:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788652157.349616:0:5829:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.150@tcp 20000000:01000000:1.0:1788652157.349619:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.150@tcp (null) (null) (null) 00000040:00080000:1.0:1788652157.349660:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788652157.349668:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788652157.349701:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788652157.349708:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.150@tcp (null) (null) 00000040:00080000:1.0:1788652157.349808:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788652157.349819:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788652157.349853:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1788652157.349888:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1788652157.349907:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1788652157.349910:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1788652157.349916:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788652157.349918:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788652157.349920:0:5829:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788652157.349933:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788652157.349935:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788652157.349975:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788652157.349978:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788652157.350654:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788652157.350982:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788652157.351038:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788652157.351222:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1788652157.351240:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788652157.351248:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788652157.352612:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1788652157.352679:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1788652157.352719:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788652157.353319:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788652157.353355:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788652157.353399:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1788652157.353413:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788652157.353416:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788652157.353982:0:6692:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788652157.354032:0:6692:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788652157.354266:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788652157.354828:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788652157.355034:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788652157.355171:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:0.0:1788652157.355190:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788652157.355210:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbe49e57e00/0x340ed74ef02a7352 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652157.355230:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe8215fc00/0x340ed74ef02a726b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a7264 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652157.355238:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe8215f000/0x340ed74ef02a7287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a7280 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652157.355245:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe8215e000/0x340ed74ef02a72f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a72f0 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652157.355253:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbe49e57e00/0x340ed74ef02a7352 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652157.355293:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe8215e000/0x340ed74ef02a72f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a72f0 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652157.355310:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe8215e000/0x340ed74ef02a72f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a72f0 expref: 12 pid: 5830 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652157.355325:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5829:1875537627714688:0@lo:104: 00000100:00100000:0.0:1788652157.356065:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788652157.356233:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe8215f000/0x340ed74ef02a7287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a7280 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652157.356245:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe8215f000/0x340ed74ef02a7287 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a7280 expref: 12 pid: 5830 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652157.356256:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5829:1875537627714816:0@lo:104: 00000100:00100000:0.0:1788652157.356286:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788652157.359546:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe8215fc00/0x340ed74ef02a726b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a7264 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652157.359565:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe8215fc00/0x340ed74ef02a726b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a7264 expref: 12 pid: 5829 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652157.359580:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5829:1875537627714944:0@lo:104: 00000100:00100000:0.0:1788652157.359630:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652157.359705:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627714688 00000100:00100000:1.0:1788652157.359713:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627714688 00000100:00100000:3.0:1788652157.359795:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627714816 00000100:00100000:3.0:1788652157.359799:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627714816 00000100:00100000:3.0:1788652157.359826:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788652157.359844:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+4:5829:x1875537627714688:12345-0@lo:104: 00010000:00010000:3.0:1788652157.359858:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57a00/0x340ed74ef02a72f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a72f7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.360398:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788652157.360408:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+4:5829:x1875537627714688:12345-0@lo:104: Request processed in 574us (4346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652157.360417:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788652157.360440:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788652157.360448:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+3:5829:x1875537627714816:12345-0@lo:104: 00010000:00010000:3.0:1788652157.360458:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe4151aa00/0x340ed74ef02a7280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a7287 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.360502:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788652157.360507:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+3:5829:x1875537627714816:12345-0@lo:104: Request processed in 61us (4221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652157.360523:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788652157.360548:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788652157.360554:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57a00/0x340ed74ef02a72f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a72f7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.360561:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e57a00 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:3.0:1788652157.360566:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57a00/0x340ed74ef02a72f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a72f7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.360575:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57a00/0x340ed74ef02a72f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a72f7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788652157.360582:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57a00/0x340ed74ef02a72f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a72f7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652157.360589:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788652157.360635:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57a00/0x340ed74ef02a72f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a72f7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.360642:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788652157.360662:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57a00/0x340ed74ef02a72f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a72f7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.360670:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57a00/0x340ed74ef02a72f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a72f7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.360685:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652157.360688:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe4151aa00/0x340ed74ef02a7280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a7287 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.360693:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151aa00 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:3.0:1788652157.360696:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe4151aa00/0x340ed74ef02a7280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a7287 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.360703:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe4151aa00/0x340ed74ef02a7280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a7287 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788652157.360709:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe4151aa00/0x340ed74ef02a7280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a7287 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652157.360714:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788652157.360727:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe4151aa00/0x340ed74ef02a7280 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7287 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.360733:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788652157.360738:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe4151aa00/0x340ed74ef02a7280 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7287 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.360754:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe4151aa00/0x340ed74ef02a7280 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7287 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.360764:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652157.360766:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652157.360768:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652157.360813:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627715072:0@lo:103: 00000100:00100000:3.0:1788652157.360854:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652157.360881:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788652157.360886:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627715200:0@lo:103: 00010000:00010000:2.0:1788652157.361172:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652157.361212:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627715072 00000100:00100000:2.0:1788652157.361218:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627715072 00010000:00010000:2.0:1788652157.361246:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe8215e000/0x340ed74ef02a72f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a72f0 expref: 13 pid: 5830 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652157.361270:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788652157.361277:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+13:3303:x1875537627715072:12345-0@lo:103: 00010000:00010000:2.0:1788652157.361288:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652157.361293:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe8215e000/0x340ed74ef02a72f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a72f0 expref: 13 pid: 5830 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652157.361314:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe8215e000/0x340ed74ef02a72f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a72f0 expref: 13 pid: 5830 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652157.361333:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652157.361363:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+13:3303:x1875537627715072:12345-0@lo:103: Request processed in 85us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652157.361371:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788652157.362469:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652157.362639:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4953fd80 going to sleep for 11 seconds 00010000:00010000:0.0:1788652157.362666:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe8215e000/0x340ed74ef02a72f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a72f0 expref: 12 pid: 5830 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652157.362686:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5829:1875537627714688:0@lo:104: 00000100:00100000:0.0:1788652157.362699:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5829:1875537627714816:0@lo:104: 00000100:00100000:3.0:1788652157.362752:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627714944 00000100:00100000:3.0:1788652157.362758:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627714944 00000100:00100000:3.0:1788652157.362813:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788652157.362822:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+3:5829:x1875537627714944:12345-0@lo:104: 00010000:00010000:3.0:1788652157.362845:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe52925c00/0x340ed74ef02a7264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a726b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.362898:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788652157.362917:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+3:5829:x1875537627714944:12345-0@lo:104: Request processed in 84us (3275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652157.362924:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788652157.362943:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652157.362949:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe52925c00/0x340ed74ef02a7264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a726b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.362956:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe52925c00 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:3.0:1788652157.362972:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe52925c00/0x340ed74ef02a7264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a726b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.362981:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe52925c00/0x340ed74ef02a7264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a726b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788652157.362988:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe52925c00/0x340ed74ef02a7264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a726b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652157.362994:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788652157.363024:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe52925c00/0x340ed74ef02a7264 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a726b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.363030:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788652157.363046:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe52925c00/0x340ed74ef02a7264 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a726b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.363053:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe52925c00/0x340ed74ef02a7264 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a726b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.363234:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652157.363237:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652157.363238:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652157.363253:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627715328:0@lo:103: 00000100:00100000:3.0:1788652157.363460:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652157.363547:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5829:1875537627714944:0@lo:104: 00010000:00010000:0.0:1788652157.363585:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbe49e57e00/0x340ed74ef02a7352 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652157.366924:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627715072:0@lo:103: 00000100:00100000:2.0:1788652157.371272:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627715200 00000100:00100000:2.0:1788652157.371291:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627715200 00010000:00010000:2.0:1788652157.371343:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe8215f000/0x340ed74ef02a7287 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a7280 expref: 12 pid: 5830 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652157.371471:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627715328 00000100:00100000:2.0:1788652157.371475:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627715328 00010000:00010000:2.0:1788652157.371490:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe8215fc00/0x340ed74ef02a726b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a7264 expref: 13 pid: 5829 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652157.371570:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788652157.371585:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+13:3303:x1875537627715200:12345-0@lo:103: 00010000:00010000:1.0:1788652157.371601:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652157.371607:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe8215f000/0x340ed74ef02a7287 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a7280 expref: 13 pid: 5830 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.371621:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe8215f000/0x340ed74ef02a7287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a7280 expref: 13 pid: 5830 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.371640:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe8215f000/0x340ed74ef02a7287 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a7280 expref: 13 pid: 5830 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.371658:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652157.371748:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+12:3303:x1875537627715200:12345-0@lo:103: Request processed in 169us (9285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652157.371756:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788652157.371808:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788652157.371816:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+11:3305:x1875537627715328:12345-0@lo:103: 00010000:00010000:1.0:1788652157.371824:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652157.371828:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe8215fc00/0x340ed74ef02a726b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a7264 expref: 11 pid: 5829 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652157.373641:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627715200:0@lo:103: 00010000:00010000:1.0:1788652157.373705:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe8215fc00/0x340ed74ef02a726b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a7264 expref: 11 pid: 5829 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.373735:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe8215fc00/0x340ed74ef02a726b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a7264 expref: 11 pid: 5829 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.373797:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbe49e57e00/0x340ed74ef02a7352 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.373806:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe49e57e00/0x340ed74ef02a7352 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.373825:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe49e57e00/0x340ed74ef02a7352 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.373842:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe49e57e00/0x340ed74ef02a7352 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.373850:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbe49e57e00/0x340ed74ef02a7352 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.373857:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbe49e57e00/0x340ed74ef02a7352 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.373863:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e57e00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:1.0:1788652157.373867:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbe49e57e00/0x340ed74ef02a7352 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.373876:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbe49e57e00/0x340ed74ef02a7352 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.373902:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbe49e57e00/0x340ed74ef02a7352 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.373923:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652157.374000:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+10:3305:x1875537627715328:12345-0@lo:103: Request processed in 2183us (10538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652157.374018:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788652157.374098:0:5829:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbe49e57e00/0x340ed74ef02a7352 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652157.374107:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbe49e57e00/0x340ed74ef02a7352 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652157.374113:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe49e57e00/0x340ed74ef02a7352 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788652157.374128:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788652157.374184:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627715328:0@lo:103: 00000100:00100000:3.0:1788652157.451114:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+9:6675:x1875537627714560:12345-0@lo:253: Request processed in 110626us (113663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652157.451131:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788652157.451288:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627714560:0@lo:253: 10000000:01000000:2.0:1788652157.451304:0:6675:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788652157.451307:0:6675:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788652157.451309:0:6675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788652157.451310:0:6675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788652157.451311:0:6675:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788652157.451312:0:6675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788652157.451314:0:6675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788652157.451315:0:6675:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788652157.451316:0:6675:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788652157.451318:0:6675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788652157.451319:0:6675:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788652157.451342:0:6675:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cbe818bc800 from lustre-OST0000 10000000:01000000:2.0:1788652157.451386:0:6675:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788652157.451390:0:6675:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788652157.451402:0:6675:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cbe4b174d40 local copy 10000000:01000000:2.0:1788652157.451406:0:6675:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788652157.451440:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f400/0x340ed74ef02a7359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652157.451452:0:6675:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f400/0x340ed74ef02a7359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652157.451472:0:6675:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f400/0x340ed74ef02a7359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652157.451492:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627715456:0@lo:101: 00000100:00100000:2.0:1788652157.451537:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652157.451607:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe42cf23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652157.451671:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627715456 00000100:00100000:0.0:1788652157.451678:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627715456 00000100:00100000:0.0:1788652157.451721:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788652157.451730:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+9:6675:x1875537627715456:12345-0@lo:101: 00010000:00010000:0.0:1788652157.451742:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652157.451756:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe49e57e00/0x340ed74ef02a7360 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a7359 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652157.451804:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe49e57e00/0x340ed74ef02a7360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a7359 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652157.451815:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe49e57e00/0x340ed74ef02a7360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a7359 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652157.451825:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e57e00, rc 0) 00000100:00100000:0.0:1788652157.451863:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+10:6675:x1875537627715456:12345-0@lo:101: Request processed in 134us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652157.451878:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788652157.452113:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627715456:0@lo:101: 00010000:00010000:3.0:1788652157.452128:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f400/0x340ed74ef02a7359 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x340ed74ef02a7360 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.452145:0:6675:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f400/0x340ed74ef02a7359 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x340ed74ef02a7360 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652157.452243:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627715584:0@lo:501: 00000100:00100000:3.0:1788652157.452270:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652157.452300:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe48696cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652157.452410:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627715584 00000100:00100000:0.0:1788652157.452415:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627715584 00000100:00100000:0.0:1788652157.452447:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788652157.452454:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+10:6675:x1875537627715584:12345-0@lo:501: 00000100:00100000:0.0:1788652157.452661:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+10:6675:x1875537627715584:12345-0@lo:501: Request processed in 207us (389us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788652157.452668:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788652157.452805:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627715584:0@lo:501: 10000000:01000000:3.0:1788652157.452820:0:6675:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788652157.452848:0:6675:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788652157.452855:0:6675:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f400/0x340ed74ef02a7359 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x340ed74ef02a7360 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.452863:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f400/0x340ed74ef02a7359 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x340ed74ef02a7360 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.452870:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f400/0x340ed74ef02a7359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x340ed74ef02a7360 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.452929:0:6675:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788652157.452947:0:6675:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cbe818bc800 10000000:01000000:3.0:1788652157.452952:0:6675:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788652157.452956:0:6675:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8cbe4b174d40 10000000:01000000:3.0:1788652157.452959:0:6675:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788652157.452962:0:6675:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8cbe4b174d40 from 1 10000000:01000000:3.0:1788652157.452964:0:6675:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788652157.452985:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe4151aa00/0x340ed74ef02a7367 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.453014:0:6675:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe4151aa00/0x340ed74ef02a7367 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.453023:0:6675:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe4151aa00/0x340ed74ef02a7367 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652157.453038:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627715712:0@lo:101: 00000100:00100000:3.0:1788652157.453076:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652157.453102:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe48696c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788652157.453443:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627715712 00000100:00100000:0.0:1788652157.453449:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627715712 00000100:00100000:0.0:1788652157.453496:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788652157.453505:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+10:6675:x1875537627715712:12345-0@lo:101: 00010000:00010000:0.0:1788652157.453521:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652157.453535:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe49e56200/0x340ed74ef02a736e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a7367 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652157.453554:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe49e56200/0x340ed74ef02a736e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a7367 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652157.453563:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe49e56200/0x340ed74ef02a736e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a7367 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652157.453572:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e56200, rc 0) 00000100:00100000:0.0:1788652157.453617:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+11:6675:x1875537627715712:12345-0@lo:101: Request processed in 112us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652157.453623:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788652157.453712:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627715712:0@lo:101: 00010000:00010000:1.0:1788652157.453725:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe4151aa00/0x340ed74ef02a7367 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a736e expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.453735:0:6675:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe4151aa00/0x340ed74ef02a7367 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a736e expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652157.453752:0:6675:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788652157.453768:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe4151aa00/0x340ed74ef02a7367 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a736e expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.453795:0:6675:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe4151aa00/0x340ed74ef02a7367 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a736e expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652157.453802:0:6675:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788652157.453806:0:6675:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788652157.453810:0:6675:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788652157.453812:0:6675:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788652157.453829:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52924e00/0x340ed74ef02a7375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.453836:0:6675:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe52924e00/0x340ed74ef02a7375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.453843:0:6675:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe52924e00/0x340ed74ef02a7375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652157.453856:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627715840:0@lo:101: 00000100:00100000:1.0:1788652157.453893:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652157.453919:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4f1d99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652157.454225:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627715840 00000100:00100000:3.0:1788652157.454230:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627715840 00000100:00100000:3.0:1788652157.454265:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788652157.454272:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+11:6675:x1875537627715840:12345-0@lo:101: 00010000:00010000:3.0:1788652157.454280:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652157.454289:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe4151a200/0x340ed74ef02a737c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a7375 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.454306:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe4151a200/0x340ed74ef02a737c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a7375 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.454315:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe4151a200/0x340ed74ef02a737c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a7375 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.454322:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe4151a200, rc 0) 00000100:00100000:3.0:1788652157.454363:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:6675:x1875537627715840:12345-0@lo:101: Request processed in 92us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652157.454369:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788652157.454497:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627715840:0@lo:101: 00010000:00010000:1.0:1788652157.454509:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe52924e00/0x340ed74ef02a7375 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a737c expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.454529:0:6675:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe52924e00/0x340ed74ef02a7375 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a737c expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652157.454613:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627715968:0@lo:501: 00000100:00100000:1.0:1788652157.454638:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652157.454662:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4f1d99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652157.454716:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627715968 00000100:00100000:3.0:1788652157.454727:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627715968 00000100:00100000:3.0:1788652157.454757:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788652157.454764:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:6675:x1875537627715968:12345-0@lo:501: 00000100:00100000:3.0:1788652157.455443:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:6675:x1875537627715968:12345-0@lo:501: Request processed in 676us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652157.455452:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1788652157.455660:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652157.455667:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f400/0x340ed74ef02a7359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x340ed74ef02a7360 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652157.455676:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215f400 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:2.0:1788652157.455680:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f400/0x340ed74ef02a7359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x340ed74ef02a7360 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652157.455688:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f400/0x340ed74ef02a7359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x340ed74ef02a7360 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652157.455696:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f400/0x340ed74ef02a7359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x340ed74ef02a7360 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652157.455702:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788652157.455726:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f400/0x340ed74ef02a7359 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x340ed74ef02a7360 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652157.455745:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652157.455794:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f400/0x340ed74ef02a7359 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x340ed74ef02a7360 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652157.455802:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f400/0x340ed74ef02a7359 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x340ed74ef02a7360 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652157.455818:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652157.455820:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652157.455822:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652157.455867:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788652157.455882:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627716096:0@lo:103: 00000100:00100000:3.0:1788652157.455918:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652157.456002:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627716096 00000100:00100000:2.0:1788652157.456007:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627716096 00000100:00100000:2.0:1788652157.456049:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788652157.456057:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f811a652-691e-4a40-b660-977a4758dd08+12:3305:x1875537627716096:12345-0@lo:103: 00010000:00010000:2.0:1788652157.456221:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652157.456236:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe49e57e00/0x340ed74ef02a7360 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x340ed74ef02a7359 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652157.456248:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652157.456292:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f811a652-691e-4a40-b660-977a4758dd08+11:3305:x1875537627716096:12345-0@lo:103: Request processed in 236us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652157.456302:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788652157.456369:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627716096:0@lo:103: 00000100:00100000:1.0:1788652157.456549:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627715968:0@lo:501: 00000100:00100000:1.0:1788652157.456584:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627716224:0@lo:503: 00000100:00100000:1.0:1788652157.456626:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652157.456687:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4f1d99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652157.456732:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627716224 00000100:00100000:0.0:1788652157.456737:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627716224 00000100:00100000:0.0:1788652157.456933:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788652157.456942:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+11:6675:x1875537627716224:12345-0@lo:503: 00000100:00100000:0.0:1788652157.457145:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+11:6675:x1875537627716224:12345-0@lo:503: Request processed in 204us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652157.457152:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788652157.457322:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627716224:0@lo:503: 00000040:00080000:1.0:1788652157.457669:0:6675:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788652157.457734:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627716352:0@lo:502: 00000100:00100000:1.0:1788652157.457795:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652157.458016:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4f1d99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652157.458168:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627716352 00000100:00100000:2.0:1788652157.458174:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627716352 00000100:00100000:2.0:1788652157.458206:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788652157.458217:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+11:6675:x1875537627716352:12345-0@lo:502: 00000100:00100000:2.0:1788652157.458400:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+11:6675:x1875537627716352:12345-0@lo:502: Request processed in 185us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652157.458417:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788652157.458563:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627716352:0@lo:502: 00000040:00080000:1.0:1788652157.458854:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788652157.458905:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788652157.458936:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788652157.458984:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788652157.459032:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788652157.459079:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788652157.459114:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627716480:0@lo:502: 00000100:00100000:1.0:1788652157.459158:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652157.459181:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4f1d99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652157.459507:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627716480 00000100:00100000:2.0:1788652157.459523:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627716480 00000100:00100000:2.0:1788652157.459554:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788652157.459563:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+11:6675:x1875537627716480:12345-0@lo:502: 00000100:00100000:2.0:1788652157.459722:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+11:6675:x1875537627716480:12345-0@lo:502: Request processed in 159us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652157.459728:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788652157.459860:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627716480:0@lo:502: 00000040:00080000:1.0:1788652157.459959:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788652157.459970:0:6675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1788652157.460653:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788652157.460662:0:6694:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788652157.460669:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652157.460672:0:6694:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788652157.460678:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788652157.460693:0:6694:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8cbe47178000) 00000020:00000080:1.0:1788652157.460714:0:6694:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788652157.460720:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788652157.460818:0:6694:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbe818bc800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788652157.460825:0:6694:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788652157.460833:0:6694:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x340ed74ef02a738a 00010000:00010000:0.0:1788652157.476006:0:6694:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1788652157.476479:0:6694:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1788652157.485264:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788652157.486214:0:6694:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788652157.501541:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788652157.502569:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788652157.504225:0:6694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788652157.504238:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788652157.504244:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652157.504246:0:6694:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788652157.504249:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788652157.504253:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652157.504255:0:6694:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788652157.504257:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788652157.504259:0:6694:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788652157.504306:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788652157.504308:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652157.504310:0:6694:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788652157.504313:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788652157.505812:0:6675:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788652157.505850:0:6675:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788652157.505870:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52924e00/0x340ed74ef02a7375 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a737c expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.505884:0:6675:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe52924e00/0x340ed74ef02a7375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a737c expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652157.505893:0:6675:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe818bc800 from 1 10000000:01000000:1.0:1788652157.505896:0:6675:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788652157.505932:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52925600/0x340ed74ef02a7391 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.505955:0:6675:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe52925600/0x340ed74ef02a7391 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.505966:0:6675:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe52925600/0x340ed74ef02a7391 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652157.505991:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627716608:0@lo:101: 00000100:00100000:1.0:1788652157.506058:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652157.506125:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4f1d9900 going to sleep for 11 seconds 00000100:00100000:0.0:1788652157.506828:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627716608 00000100:00100000:0.0:1788652157.506838:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627716608 00000100:00100000:0.0:1788652157.506898:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788652157.506908:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+11:6675:x1875537627716608:12345-0@lo:101: 00010000:00010000:0.0:1788652157.506923:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652157.506940:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe49e56e00/0x340ed74ef02a7398 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a7391 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652157.506973:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe49e56e00/0x340ed74ef02a7398 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a7391 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652157.506984:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe49e56e00/0x340ed74ef02a7398 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a7391 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652157.506992:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e56e00, rc 0) 00000100:00100000:0.0:1788652157.507043:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+12:6675:x1875537627716608:12345-0@lo:101: Request processed in 136us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652157.507049:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788652157.507216:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627716608:0@lo:101: 00010000:00010000:1.0:1788652157.507233:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe52925600/0x340ed74ef02a7391 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7398 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.507242:0:6675:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe52925600/0x340ed74ef02a7391 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a7398 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652157.507414:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627716736:0@lo:501: 00000100:00100000:1.0:1788652157.507442:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652157.507478:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4f1d9900 going to sleep for 11 seconds 00000100:00100000:0.0:1788652157.507758:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627716736 00000100:00100000:0.0:1788652157.507765:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627716736 00000100:00100000:0.0:1788652157.507812:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788652157.507820:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:6675:x1875537627716736:12345-0@lo:501: 00000100:00100000:0.0:1788652157.508042:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:6675:x1875537627716736:12345-0@lo:501: Request processed in 222us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652157.508049:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788652157.511795:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627716736:0@lo:501: 00000100:00100000:1.0:1788652157.511863:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627716864:0@lo:503: 00000100:00100000:1.0:1788652157.511936:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652157.511979:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4f1d9900 going to sleep for 11 seconds 00000100:00100000:0.0:1788652157.512060:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627716864 00000100:00100000:0.0:1788652157.512077:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627716864 00000100:00100000:0.0:1788652157.512121:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788652157.512130:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+12:6675:x1875537627716864:12345-0@lo:503: 00000100:00100000:0.0:1788652157.512386:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+12:6675:x1875537627716864:12345-0@lo:503: Request processed in 256us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652157.512393:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788652157.512588:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627716864:0@lo:503: 00000040:00080000:1.0:1788652157.512979:0:6675:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788652157.513052:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627716992:0@lo:502: 00000100:00100000:1.0:1788652157.513420:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652157.513489:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4f1d9900 going to sleep for 11 seconds 00000100:00100000:0.0:1788652157.515890:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627716992 00000100:00100000:0.0:1788652157.515910:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627716992 00000100:00100000:1.0:1788652157.516031:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788652157.516042:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+12:6675:x1875537627716992:12345-0@lo:502: 00000100:00100000:3.0:1788652157.516444:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627716992:0@lo:502: 00000040:00080000:3.0:1788652157.516797:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788652157.516853:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788652157.516892:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627717120:0@lo:502: 00000100:00100000:1.0:1788652157.517188:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+12:6675:x1875537627716992:12345-0@lo:502: Request processed in 1145us (3766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652157.517198:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788652157.517849:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652157.517892:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe48696c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788652157.517996:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627717120 00000100:00100000:0.0:1788652157.518010:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627717120 00000100:00100000:0.0:1788652157.518279:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788652157.518288:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:6675:x1875537627717120:12345-0@lo:502: 00000100:00100000:0.0:1788652157.518505:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:6675:x1875537627717120:12345-0@lo:502: Request processed in 217us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652157.518521:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788652157.518599:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627717120:0@lo:502: 00000040:00080000:2.0:1788652157.518741:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788652157.518756:0:6675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788652157.519688:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788652157.519701:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652157.519703:0:6698:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788652157.519710:0:6698:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbe818bc800 00000020:00000080:2.0:1788652157.519712:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788652157.519731:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652157.519734:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652157.519736:0:6698:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788652157.519738:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788652157.519998:0:6675:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788652157.520021:0:6675:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788652157.520128:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52925600/0x340ed74ef02a7391 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7398 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.520141:0:6675:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe52925600/0x340ed74ef02a7391 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7398 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652157.520197:0:6675:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788652157.520200:0:6675:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cbe818bc800 10000000:01000000:3.0:1788652157.520203:0:6675:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cbe818bc800 10000000:01000000:3.0:1788652157.520207:0:6675:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788652157.520212:0:6675:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbe818bc800 from 1 10000000:01000000:3.0:1788652157.520222:0:6675:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788652157.520255:0:6675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a739f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.520264:0:6675:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a739f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.520275:0:6675:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a739f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652157.520295:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627717248:0@lo:101: 00000100:00100000:3.0:1788652157.520413:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652157.520454:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe48696a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788652157.520589:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627717248 00000100:00100000:1.0:1788652157.520599:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627717248 00000100:00100000:1.0:1788652157.520650:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788652157.520659:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+12:6675:x1875537627717248:12345-0@lo:101: 00010000:00010000:1.0:1788652157.520671:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652157.520685:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe52924200/0x340ed74ef02a73a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a739f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.520709:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe52924200/0x340ed74ef02a73a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a739f expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.520718:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe52924200/0x340ed74ef02a73a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a739f expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.520726:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe52924200, rc 0) 00000100:00100000:1.0:1788652157.520807:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+13:6675:x1875537627717248:12345-0@lo:101: Request processed in 149us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652157.520813:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788652157.520973:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627717248:0@lo:101: 00010000:00010000:3.0:1788652157.520986:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a739f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a73a6 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.520995:0:6675:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a739f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a73a6 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652157.521208:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627717376:0@lo:501: 00000100:00100000:3.0:1788652157.521235:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652157.521266:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe48696a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788652157.521317:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627717376 00000100:00100000:1.0:1788652157.521390:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627717376 00000100:00100000:1.0:1788652157.521435:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788652157.521442:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+13:6675:x1875537627717376:12345-0@lo:501: 00000100:00100000:1.0:1788652157.521679:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+13:6675:x1875537627717376:12345-0@lo:501: Request processed in 237us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652157.521687:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788652157.521921:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627717376:0@lo:501: 00000100:00100000:3.0:1788652157.521950:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627717504:0@lo:503: 00000100:00100000:3.0:1788652157.521989:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652157.522054:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe48696a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788652157.522146:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627717504 00000100:00100000:2.0:1788652157.522151:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627717504 00000100:00100000:2.0:1788652157.522186:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788652157.522194:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+13:6675:x1875537627717504:12345-0@lo:503: 00000100:00100000:2.0:1788652157.522384:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+13:6675:x1875537627717504:12345-0@lo:503: Request processed in 191us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652157.522400:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788652157.522419:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627717504:0@lo:503: 00000040:00080000:3.0:1788652157.522682:0:6675:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788652157.522738:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627717632:0@lo:502: 00000100:00100000:3.0:1788652157.522797:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652157.522820:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe48696a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788652157.522878:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627717632 00000100:00100000:2.0:1788652157.522882:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627717632 00000100:00100000:2.0:1788652157.522915:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788652157.522922:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+13:6675:x1875537627717632:12345-0@lo:502: 00000100:00100000:3.0:1788652157.523319:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627717632:0@lo:502: 00000040:00080000:3.0:1788652157.523588:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788652157.523636:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788652157.523668:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788652157.523728:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788652157.523767:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788652157.523846:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788652157.523882:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788652157.523916:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788652157.523975:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788652157.524014:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788652157.524048:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788652157.524172:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788652157.524212:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788652157.524242:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788652157.524286:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788652157.524322:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788652157.524355:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788652157.524401:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788652157.524435:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788652157.524468:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788652157.524526:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788652157.524563:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788652157.524601:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788652157.524667:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788652157.524704:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788652157.524749:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788652157.524847:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788652157.524886:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1788652157.524926:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627717760:0@lo:502: 00000100:00100000:3.0:1788652157.524989:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652157.525029:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe48696a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788652157.525251:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627717760 00000100:00100000:1.0:1788652157.525259:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627717760 00000100:00100000:1.0:1788652157.525304:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788652157.525313:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+14:6675:x1875537627717760:12345-0@lo:502: 00000100:00100000:1.0:1788652157.525542:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+14:6675:x1875537627717760:12345-0@lo:502: Request processed in 229us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652157.525550:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788652157.525706:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627717760:0@lo:502: 00000040:00080000:0.0:1788652157.525824:0:6675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788652157.525837:0:6675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788652157.526575:0:6699:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788652157.526593:0:6699:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8cbe4b170000) 00000020:00000080:0.0:1788652157.526617:0:6699:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1788652157.526694:0:6699:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbe818bc800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788652157.526698:0:6699:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbe818bc800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788652157.526701:0:6699:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe818bc800 3 00010000:00080000:0.0:1788652157.526737:0:6699:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbe7f687000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.150@tcp at head 00000100:00100000:2.0:1788652157.527000:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+13:6675:x1875537627717632:12345-0@lo:502: Request processed in 4075us (4200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652157.527011:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:2.0:1788652157.529283:0:6699:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1788652157.529626:0:6699:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788652157.529664:0:6699:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788652157.529677:0:6699:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x340ed74ef02a73b4 00000100:00080000:2.0:1788652157.529687:0:6699:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788652157.529694:0:6699:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cbe7f687000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1788652157.529728:0:6699:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe759a9880 x1875537627717888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788652157.529756:0:6699:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788652157.529931:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788652157.529946:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627718016:0@lo:400: 00000100:00100000:1.0:1788652157.530052:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788652157.530479:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:0.0:1788652157.530732:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875537627717888:0@lo:38: 00000100:00100000:0.0:1788652157.530797:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652157.530984:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627718016 00000100:00100000:2.0:1788652157.530992:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627718016 00000100:00100000:2.0:1788652157.531037:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627717888 00000100:00100000:2.0:1788652157.531040:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627717888 00000100:00100000:2.0:1788652157.531055:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788652157.531063:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627718016:12345-0@lo:400: 00000100:00100000:0.0:1788652157.531140:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788652157.531148:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788652157.531314:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788652157.531332:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3302:x1875537627717888:12345-0@lo:38: 00010000:00080000:1.0:1788652157.531358:0:5836:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:1.0:1788652157.531388:0:5836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x340ed74ef02a73bb 00000004:00100000:1.0:1788652157.531403:0:5836:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788652157.531431:0:5836:0:(import.c:65:import_set_state_nolock()) ffff8cbe7f618800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788652157.531489:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875537627717888:12345-0@lo:38: Request processed in 167us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652157.531495:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788652157.531554:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cbe759a9880 x1875537627717888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788652167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652157.531581:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788652157.531589:0:3302:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788652157.531596:0:3302:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788652157.531600:0:3302:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788652157.531602:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cbe7f687000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788652157.531608:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875537627717888:0@lo:38: 00000100:00100000:2.0:1788652157.531754:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627718016:12345-0@lo:400: Request processed in 692us (1702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652157.531761:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788652157.532013:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cbe4b192d80 x1875537627718016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652157.532023:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627718016:0@lo:400: 00000020:01000000:2.0:1788652157.532945:0:6675:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788652157.532995:0:6675:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788652157.533021:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a739f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a73a6 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652157.533032:0:6675:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a739f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a73a6 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788652157.533190:0:6675:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788652157.533193:0:6675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788652157.533194:0:6675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788652157.533195:0:6675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788652157.533196:0:6675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788652157.533198:0:6675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788652157.533199:0:6675:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788652157.533201:0:6675:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788652157.533202:0:6675:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788652157.533204:0:6675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788652157.533205:0:6675:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788652157.533209:0:6675:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788652157.533211:0:6675:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788652157.533212:0:6675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788652157.533213:0:6675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788652157.533215:0:6675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788652157.533216:0:6675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788652157.533217:0:6675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788652157.533217:0:6675:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788652157.533218:0:6675:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788652157.533219:0:6675:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788652157.533220:0:6675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788652157.533221:0:6675:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788652157.533247:0:6675:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788652157.533264:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627718144:0@lo:253: 00000100:00100000:2.0:1788652157.533317:0:6675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652157.534187:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe434c8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788652157.537938:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627718144 00000100:00100000:1.0:1788652157.537953:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627718144 00000100:00100000:1.0:1788652157.538041:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788652157.538052:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+13:6675:x1875537627718144:12345-0@lo:253: 20000000:01000000:1.0:1788652157.538257:0:5829:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788652157.538273:0:5829:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788652157.562941:0:5829:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788652157.562965:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788652157.563225:0:5851:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788652157.563231:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788652157.563256:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a73c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.563275:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe52925000/0x340ed74ef02a7321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a731a expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.563284:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a73c2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.563398:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe52925000/0x340ed74ef02a7321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a731a expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652157.563415:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe52925000/0x340ed74ef02a7321 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a731a expref: 13 pid: 5830 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652157.563431:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1875537627718272:0@lo:104: 00000100:00100000:3.0:1788652157.563495:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652157.563558:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4818d780 going to sleep for 11 seconds 00000100:00100000:1.0:1788652157.563616:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627718272 00000100:00100000:1.0:1788652157.563624:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627718272 00000100:00100000:1.0:1788652157.563677:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788652157.563686:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f811a652-691e-4a40-b660-977a4758dd08+3:5851:x1875537627718272:12345-0@lo:104: 00010000:00010000:1.0:1788652157.563699:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a400/0x340ed74ef02a731a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a7321 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.563756:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788652157.563762:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f811a652-691e-4a40-b660-977a4758dd08+3:5851:x1875537627718272:12345-0@lo:104: Request processed in 78us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652157.563810:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788652157.563833:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652157.563840:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a400/0x340ed74ef02a731a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a7321 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.563853:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151a400 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:1.0:1788652157.563857:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a400/0x340ed74ef02a731a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a7321 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.563866:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a400/0x340ed74ef02a731a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a7321 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788652157.563874:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a400/0x340ed74ef02a731a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a7321 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652157.563880:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788652157.563936:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a400/0x340ed74ef02a731a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7321 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.563942:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788652157.563958:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a400/0x340ed74ef02a731a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7321 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.563964:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a400/0x340ed74ef02a731a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7321 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.563980:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652157.563982:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652157.563983:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652157.563990:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788652157.564005:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627718400:0@lo:103: 00000100:00100000:1.0:1788652157.564035:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652157.564064:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627718400 00000100:00100000:1.0:1788652157.564137:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627718400 00010000:00010000:1.0:1788652157.564156:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe52925000/0x340ed74ef02a7321 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a731a expref: 14 pid: 5830 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652157.564179:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788652157.564185:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51232c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+14:3303:x1875537627718400:12345-0@lo:103: 00010000:00010000:1.0:1788652157.564194:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652157.564198:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe52925000/0x340ed74ef02a7321 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a731a expref: 14 pid: 5830 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.564208:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe52925000/0x340ed74ef02a7321 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a731a expref: 14 pid: 5830 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.564224:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a73c2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.564232:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a73c2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788652157.564243:0:5821:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002947561s 00010000:00010000:1.0:1788652157.564247:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a73c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.564254:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a73c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.564261:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a73c2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.564278:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a73c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.564284:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151ac00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:1.0:1788652157.564288:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a73c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.564296:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a73c2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.564304:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a73c2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.564313:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652157.564586:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51232c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+14:3303:x1875537627718400:12345-0@lo:103: Request processed in 398us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652157.564593:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788652157.564669:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe52925000/0x340ed74ef02a7321 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a731a expref: 13 pid: 5830 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652157.564680:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1875537627718272:0@lo:104: 00010000:00010000:1.0:1788652157.564695:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a73c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.564703:0:5851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a73c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.564709:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a73c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652157.564726:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a73c2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652157.566828:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627718400:0@lo:103: 00000100:00100000:3.0:1788652157.573004:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:6675:x1875537627718144:12345-0@lo:253: Request processed in 34943us (39675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652157.573018:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788652157.573189:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:6675:1875537627718144:0@lo:253: 10000000:01000000:0.0:1788652157.573206:0:6675:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788652157.573209:0:6675:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788652157.573211:0:6675:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788652157.573213:0:6675:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788652157.573214:0:6675:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788652157.573215:0:6675:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788652157.573217:0:6675:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788652157.573219:0:6675:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788652157.573220:0:6675:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788652157.573228:0:6675:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788652157.573230:0:6675:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788652157.573231:0:6675:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788652157.573247:0:6675:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788652157.582268:0:6675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788652157.582691:0:6675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788652157.582971:0:6675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788652157.583532:0:6675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788652157.584852:0:6675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788652157.585291:0:6675:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788652157.586997:0:6675:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788652157.862176:0:6675:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788652157.862184:0:6675:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788652157.862219:0:6675:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788652157.862285:0:6675:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.150@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788652157.862301:0:6675:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788652157.862331:0:6675:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788652158.217033:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652159.244174:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788652159.627140:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788652159.627148:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbe50c46000 from 21 10000000:01000000:0.0:1788652159.627155:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788652159.627203:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56c00/0x340ed74ef02a73c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652159.627215:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56c00/0x340ed74ef02a73c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652159.627227:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56c00/0x340ed74ef02a73c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652159.627251:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627718528:0@lo:101: 00000100:00100000:0.0:1788652159.627314:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652159.627377:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fd6b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788652159.627392:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627718528 00000100:00100000:3.0:1788652159.627401:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627718528 00000100:00100000:3.0:1788652159.627459:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788652159.627469:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+12:5832:x1875537627718528:12345-0@lo:101: 00010000:00010000:3.0:1788652159.627482:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652159.627506:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a73d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a73c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652159.627530:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a73d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a73c9 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652159.627551:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a73d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a73c9 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652159.627560:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe4151ac00, rc 0) 00000100:00100000:3.0:1788652159.627610:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+13:5832:x1875537627718528:12345-0@lo:101: Request processed in 142us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652159.627616:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788652159.627676:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627718528:0@lo:101: 00010000:00010000:0.0:1788652159.627691:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56c00/0x340ed74ef02a73c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a73d0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652159.627700:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56c00/0x340ed74ef02a73c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a73d0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652159.627794:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627718656:0@lo:501: 00000100:00100000:0.0:1788652159.627819:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652159.627849:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fd6b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788652159.627972:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627718656 00000100:00100000:3.0:1788652159.627977:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627718656 00000100:00100000:3.0:1788652159.628008:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788652159.628016:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+13:5832:x1875537627718656:12345-0@lo:501: 00000100:00100000:3.0:1788652159.628415:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+13:5832:x1875537627718656:12345-0@lo:501: Request processed in 399us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652159.628422:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788652159.634638:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627718656:0@lo:501: 00000100:00100000:0.0:1788652159.634701:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627718784:0@lo:503: 00000100:00100000:0.0:1788652159.634790:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652159.634837:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fd6b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788652159.634867:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627718784 00000100:00100000:0.0:1788652159.634873:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627718784 00000100:00100000:0.0:1788652159.634931:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788652159.634941:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+13:5832:x1875537627718784:12345-0@lo:503: 00000100:00100000:0.0:1788652159.635312:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+13:5832:x1875537627718784:12345-0@lo:503: Request processed in 372us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652159.635321:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788652159.635375:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627718784:0@lo:503: 00000100:00100000:1.0:1788652159.636103:0:6785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b190000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:6785:1875537627718912:0@lo:502: 00000100:00100000:1.0:1788652159.636153:0:6785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652159.636189:0:6785:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b09aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788652159.636313:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627718912 00000100:00100000:3.0:1788652159.636319:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627718912 00000100:00100000:3.0:1788652159.636365:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788652159.636374:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+13:6785:x1875537627718912:12345-0@lo:502: 00000100:00100000:3.0:1788652159.636618:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+13:6785:x1875537627718912:12345-0@lo:502: Request processed in 243us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652159.636626:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788652159.636732:0:6785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b190000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:6785:1875537627718912:0@lo:502: 00000100:00100000:1.0:1788652159.636799:0:6785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b190000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:6785:1875537627719040:0@lo:502: 00000100:00100000:1.0:1788652159.636838:0:6785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652159.636877:0:6785:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b09aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788652159.644174:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627719040 00000100:00100000:0.0:1788652159.644190:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627719040 00000100:00100000:0.0:1788652159.644309:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788652159.644319:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+13:6785:x1875537627719040:12345-0@lo:502: 00000100:00100000:0.0:1788652159.644629:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+13:6785:x1875537627719040:12345-0@lo:502: Request processed in 311us (7790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652159.644637:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788652159.644860:0:6785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b190000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:6785:1875537627719040:0@lo:502: 00000040:00080000:0.0:1788652159.644896:0:6785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788652159.645280:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788652159.645307:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788652159.645318:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56c00/0x340ed74ef02a73c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a73d0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652159.645328:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56c00/0x340ed74ef02a73c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a73d0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652159.645338:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788652159.645341:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbe50c46000 from 4 10000000:01000000:3.0:1788652159.645343:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788652159.645377:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a400/0x340ed74ef02a73d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652159.645387:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a400/0x340ed74ef02a73d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652159.645396:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a400/0x340ed74ef02a73d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652159.645428:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627719168:0@lo:101: 00000100:00100000:3.0:1788652159.645476:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652159.645526:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe47da4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788652159.645601:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627719168 00000100:00100000:0.0:1788652159.645607:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627719168 00000100:00100000:0.0:1788652159.645641:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788652159.645650:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+13:5832:x1875537627719168:12345-0@lo:101: 00010000:00010000:0.0:1788652159.645660:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652159.645673:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe49e56600/0x340ed74ef02a73de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a73d7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652159.645695:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe49e56600/0x340ed74ef02a73de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a73d7 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652159.645704:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe49e56600/0x340ed74ef02a73de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a73d7 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652159.645712:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e56600, rc 0) 00000100:00100000:0.0:1788652159.645839:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+14:5832:x1875537627719168:12345-0@lo:101: Request processed in 190us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652159.645845:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788652159.645891:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627719168:0@lo:101: 00010000:00010000:0.0:1788652159.645920:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a400/0x340ed74ef02a73d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a73de expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652159.645930:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a400/0x340ed74ef02a73d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a73de expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652159.646031:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627719296:0@lo:256: 00000100:00100000:0.0:1788652159.646091:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652159.646341:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fd6b540 going to sleep for 11 seconds 00000100:00100000:0.0:1788652159.646355:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627719296 00000100:00100000:0.0:1788652159.646364:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627719296 00000100:00100000:0.0:1788652159.646387:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788652159.646392:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+14:5832:x1875537627719296:12345-0@lo:256: 20000000:01000000:0.0:1788652159.646406:0:5829:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788652159.646421:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788652159.646424:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788652159.646556:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+14:5832:x1875537627719296:12345-0@lo:256: Request processed in 163us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652159.646564:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788652159.646649:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627719296:0@lo:256: 10000000:01000000:0.0:1788652159.646688:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788652159.646694:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a400/0x340ed74ef02a73d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a73de expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652159.646703:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a400/0x340ed74ef02a73d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a73de expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652159.646711:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788652159.646713:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788652159.646716:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788652159.646733:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57600/0x340ed74ef02a73e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652159.646741:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57600/0x340ed74ef02a73e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652159.646748:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57600/0x340ed74ef02a73e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652159.646760:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627719424:0@lo:101: 00000100:00100000:0.0:1788652159.646815:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652159.646833:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fd6b540 going to sleep for 11 seconds 00000100:00100000:0.0:1788652159.646843:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627719424 00000100:00100000:0.0:1788652159.646846:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627719424 00000100:00100000:0.0:1788652159.646864:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788652159.646870:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+14:5832:x1875537627719424:12345-0@lo:101: 00010000:00010000:0.0:1788652159.646877:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652159.646885:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe49e56800/0x340ed74ef02a73ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a73e5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652159.646901:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe49e56800/0x340ed74ef02a73ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a73e5 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652159.647358:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe49e56800/0x340ed74ef02a73ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a73e5 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652159.647368:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e56800, rc 0) 00000100:00100000:0.0:1788652159.647412:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+15:5832:x1875537627719424:12345-0@lo:101: Request processed in 542us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652159.647419:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788652159.647560:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627719424:0@lo:101: 00010000:00010000:1.0:1788652159.648021:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57600/0x340ed74ef02a73e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a73ec expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652159.648032:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57600/0x340ed74ef02a73e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a73ec expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652159.648096:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b191500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627719552:0@lo:501: 00000100:00100000:1.0:1788652159.648879:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652159.648967:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b09a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788652159.650426:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627719552 00000100:00100000:3.0:1788652159.650438:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627719552 00000100:00100000:3.0:1788652159.650544:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788652159.650641:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+15:5832:x1875537627719552:12345-0@lo:501: 00000100:00100000:3.0:1788652159.651280:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+15:5832:x1875537627719552:12345-0@lo:501: Request processed in 726us (2401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652159.651290:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788652159.651363:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b191500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627719552:0@lo:501: 00000100:00100000:0.0:1788652159.651414:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627719680:0@lo:503: 00000100:00100000:0.0:1788652159.651678:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652159.651747:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fd6b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788652159.651824:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627719680 00000100:00100000:3.0:1788652159.651830:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627719680 00000100:00100000:3.0:1788652159.651885:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788652159.651892:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+15:5832:x1875537627719680:12345-0@lo:503: 00000100:00100000:3.0:1788652159.652128:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+15:5832:x1875537627719680:12345-0@lo:503: Request processed in 235us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652159.652135:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788652159.652264:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627719680:0@lo:503: 00000100:00100000:0.0:1788652159.652453:0:6787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:6787:1875537627719808:0@lo:502: 00000100:00100000:0.0:1788652159.652803:0:6787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652159.652828:0:6787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fd6bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788652159.652873:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627719808 00000100:00100000:3.0:1788652159.652878:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627719808 00000100:00100000:3.0:1788652159.653010:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788652159.653018:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+15:6787:x1875537627719808:12345-0@lo:502: 00000100:00100000:3.0:1788652159.653226:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+15:6787:x1875537627719808:12345-0@lo:502: Request processed in 208us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652159.653233:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788652159.653309:0:6787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:6787:1875537627719808:0@lo:502: 00000020:01000000:3.0:1788652159.653339:0:6787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788652159.653345:0:6787:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788652159.653352:0:6787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652159.653354:0:6787:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788652159.653358:0:6787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788652159.653361:0:6787:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.150@tcp to nid 0x20000c0a8cb96 (192.168.203.150@tcp) 00000020:01000000:3.0:1788652159.653382:0:6787:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788652159.653385:0:6787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788652159.653399:0:6787:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8cbe759699c0) 00000020:00000080:3.0:1788652159.653419:0:6787:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788652159.653423:0:6787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788652159.653550:0:6787:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788652159.654133:0:6787:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788652159.654144:0:6787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x340ed74ef02a73fa 00010000:00080000:3.0:1788652159.654179:0:6787:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbe7f384000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.150@tcp at head 00010000:00010000:3.0:1788652159.654397:0:6787:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788652159.743372:0:6787:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788652159.743399:0:6787:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788652159.743931:0:6787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788652159.744117:0:6787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788652159.744160:0:6787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788652159.744215:0:6787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788652159.745474:0:6799:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788652159.745480:0:6799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788652159.746267:0:6787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788652159.746277:0:6787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788652159.746310:0:6787:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788652159.746330:0:6787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x340ed74ef02a7401 00000100:00080000:3.0:1788652159.746340:0:6787:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788652159.746346:0:6787:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cbe7f384000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1788652159.746382:0:6787:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe7a8b5880 x1875537627719936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788652159.746447:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875537627719936:0@lo:8: 00000100:00100000:1.0:1788652159.746520:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788652159.746613:0:6787:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788652159.746669:0:6787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652159.746673:0:6787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652159.746674:0:6787:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788652159.746677:0:6787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652159.746680:0:6787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652159.746682:0:6787:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788652159.746685:0:6787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788652159.746687:0:6787:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788652159.746711:0:6787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:6787:1875537627720064:0@lo:502: 00000100:00100000:3.0:1788652159.746755:0:6787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652159.746798:0:6787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4945d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788652159.746860:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627719936 00000100:00100000:2.0:1788652159.746868:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627719936 00000100:00100000:2.0:1788652159.746905:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788652159.746914:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1875537627719936:12345-0@lo:8: 00010000:00080000:2.0:1788652159.746940:0:6678:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:2.0:1788652159.746966:0:6678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x340ed74ef02a7408 00002000:00100000:2.0:1788652159.746998:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8cbe7f669000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788652159.747003:0:6678:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1788652159.747007:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788652159.747207:0:6678:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788652159.747335:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788652159.747357:0:6678:0:(import.c:65:import_set_state_nolock()) ffff8cbe7f66f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788652159.747512:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627720064 00000100:00100000:0.0:1788652159.747518:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627720064 00000100:00100000:0.0:1788652159.747565:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788652159.747574:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+15:6787:x1875537627720064:12345-0@lo:502: 00000100:00100000:2.0:1788652159.747608:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1875537627719936:12345-0@lo:8: Request processed in 692us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652159.747615:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788652159.747681:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe7a8b5880 x1875537627719936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788652169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652159.747704:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788652159.747712:0:3302:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788652159.747720:0:3302:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:0.0:1788652159.747824:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+15:6787:x1875537627720064:12345-0@lo:502: Request processed in 250us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652159.747833:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788652159.752032:0:6787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:6787:1875537627720064:0@lo:502: 00000020:01000000:2.0:1788652159.752091:0:6787:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652159.752098:0:6787:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652159.752101:0:6787:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788652159.752108:0:6787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00080000:1.0:1788652159.753284:0:3302:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788652159.753289:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cbe7f384000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788652159.753302:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788652159.753313:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875537627719936:0@lo:8: 00000020:01000000:0.0:1788652159.753337:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788652159.753363:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788652159.753375:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57600/0x340ed74ef02a73e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a73ec expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652159.753388:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57600/0x340ed74ef02a73e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a73ec expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652159.753397:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788652159.753401:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cbe4b174d40 from 1 10000000:01000000:0.0:1788652159.753404:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788652159.753433:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a740f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652159.753436:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875537627720192:0@lo:400: 00010000:00010000:0.0:1788652159.753449:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a740f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652159.753461:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a740f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652159.753479:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627720448:0@lo:101: 00000100:00100000:1.0:1788652159.753516:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652159.753531:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652159.753562:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788652159.753570:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b191880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627720320:0@lo:400: 00000100:00100000:0.0:1788652159.753580:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fd6b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788652159.753600:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652159.753625:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627720448 00000100:00100000:0.0:1788652159.753633:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627720448 00000100:00100000:1.0:1788652159.753638:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627720192 00000100:00100000:1.0:1788652159.753643:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627720192 00000100:00100000:0.0:1788652159.753678:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788652159.753680:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627720320 00000100:00100000:1.0:1788652159.753684:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627720320 00000100:00100000:0.0:1788652159.753690:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+15:5832:x1875537627720448:12345-0@lo:101: 00010000:00010000:0.0:1788652159.753703:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1788652159.753717:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788652159.753717:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe49e57000/0x340ed74ef02a7416 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a740f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652159.753728:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875537627720192:12345-0@lo:400: 00010000:00010000:0.0:1788652159.753745:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe49e57000/0x340ed74ef02a7416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a740f expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652159.753756:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe49e57000/0x340ed74ef02a7416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a740f expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652159.753764:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e57000, rc 0) 00000100:00100000:1.0:1788652159.753812:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875537627720192:12345-0@lo:400: Request processed in 85us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652159.753817:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+16:5832:x1875537627720448:12345-0@lo:101: Request processed in 130us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652159.753824:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788652159.753829:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788652159.753845:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788652159.753854:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627720320:12345-0@lo:400: 00000100:00100000:0.0:1788652159.753887:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627720448:0@lo:101: 00000100:00100000:1.0:1788652159.753893:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627720320:12345-0@lo:400: Request processed in 39us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652159.753901:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788652159.753904:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a740f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7416 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652159.753918:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a740f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a7416 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788652159.753932:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788652159.753956:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe4b191880 x1875537627720320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652159.753968:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b191880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627720320:0@lo:400: 00000100:00100000:0.0:1788652159.753971:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627720576:0@lo:501: 00010000:00080000:1.0:1788652159.753983:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe4b192a00 x1875537627720192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652159.753992:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875537627720192:0@lo:400: 00000100:00100000:0.0:1788652159.754002:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788652159.756367:0:6799:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788652159.756523:0:6799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 176739750252ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788652159.756730:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627720576 00000100:00100000:1.0:1788652159.756741:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627720576 00000100:00100000:1.0:1788652159.756813:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788652159.756824:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+16:5832:x1875537627720576:12345-0@lo:501: 00000100:00100000:1.0:1788652159.757174:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+16:5832:x1875537627720576:12345-0@lo:501: Request processed in 352us (3171us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788652159.757182:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788652159.759634:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fd6b600 going to sleep for 11 seconds 00000100:00100000:0.0:1788652159.759679:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627720576:0@lo:501: 10000000:01000000:0.0:1788652159.759732:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788652159.759743:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a740f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7416 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652159.759754:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a740f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7416 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788652159.814340:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788652159.921359:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:2.0:1788652159.921383:0:6800:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788652159.921411:0:6800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6800:1875537627720832:0@lo:7: 00000100:00100000:2.0:1788652159.921472:0:6800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652159.921564:0:6800:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4a5d79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652159.923222:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627720704:0@lo:13: 00000100:00100000:1.0:1788652159.923275:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652159.923363:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627720704 00000100:00100000:3.0:1788652159.923371:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627720704 00000100:00100000:3.0:1788652159.923430:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788652159.923439:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875537627720704:12345-0@lo:13: 00002000:00000024:3.0:1788652159.923471:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788652159.923526:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875537627720704:12345-0@lo:13: Request processed in 88us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652159.923533:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788652159.923569:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe759a9c00 x1875537627720704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652175 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652159.923588:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627720704:0@lo:13: 00000100:00080000:1.0:1788652159.923646:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788652159.925175:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627720832 00000100:00100000:0.0:1788652159.925188:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627720832 00000100:00100000:0.0:1788652159.925234:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788652159.925242:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6800:x1875537627720832:12345-0@lo:7: 00002000:00080000:0.0:1788652159.934429:0:6680:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788652159.934437:0:6680:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788652159.934539:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6800:x1875537627720832:12345-0@lo:7: Request processed in 9294us (13063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652159.934550:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788652159.934888:0:6800:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe759a8a80 x1875537627720832/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788652175 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652159.934903:0:6800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6800:1875537627720832:0@lo:7: 00000004:00080000:2.0:1788652159.934926:0:6800:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788652159.934960:0:6800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6800:1875537627720960:0@lo:5: 00000100:00100000:2.0:1788652159.934991:0:6800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652159.935028:0:6800:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4a5d79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652159.935296:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627720960 00000100:00100000:3.0:1788652159.935303:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627720960 00000100:00100000:3.0:1788652159.935346:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788652159.935354:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6800:x1875537627720960:12345-0@lo:5: 00002000:00080000:3.0:1788652159.935389:0:6678:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788652159.935393:0:6678:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788652159.935692:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6800:x1875537627720960:12345-0@lo:5: Request processed in 338us (699us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788652159.935699:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788652159.935761:0:6800:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe759a8a80 x1875537627720960/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788652175 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652159.935798:0:6800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6800:1875537627720960:0@lo:5: 00000004:00080000:2.0:1788652159.935807:0:6800:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788652159.935833:0:6800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6800:1875537627721088:0@lo:700: 00000100:00100000:2.0:1788652159.935856:0:6800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652159.935872:0:6800:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4a5d79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652159.936217:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627721088 00000100:00100000:3.0:1788652159.936222:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627721088 00000100:00100000:3.0:1788652159.936255:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788652159.936261:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6800:x1875537627721088:12345-0@lo:700: 00000100:00100000:3.0:1788652159.936289:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6686:1875537627721216:0@lo:700: 00000100:00100000:3.0:1788652159.936316:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652159.936332:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe42cf29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652159.936349:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627721216 00000100:00100000:3.0:1788652159.936351:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627721216 00000100:00100000:3.0:1788652159.936371:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788652159.936376:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6686:x1875537627721216:12345-0@lo:700: 40000000:02000000:3.0:1788652159.988174:0:5842:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1788652160.002433:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6686:x1875537627721216:12345-0@lo:700: Request processed in 66046us (66105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652160.002449:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788652160.002514:0:6686:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe7a8b4e00 x1875537627721216/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788652175 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652160.002530:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6686:1875537627721216:0@lo:700: 40000000:02000000:3.0:1788652160.002544:0:6686:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:0.0:1788652160.097015:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6800:x1875537627721088:12345-0@lo:700: Request processed in 160742us (161146us total) trans 0 rc 0/0 00010000:00080000:2.0:1788652160.097161:0:6800:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe759a8380 x1875537627721088/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788652175 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652160.097180:0:6800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6800:1875537627721088:0@lo:700: 00000100:00100000:0.0:1788652160.097460:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00100000:0.0:1788652160.097513:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788652160.097527:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000004:02000040:2.0:1788652160.141875:0:6800:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1788652160.147017:0:6800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6800:1875537627721344:0@lo:5: 00000100:00100000:2.0:1788652160.147146:0:6800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652160.147336:0:6800:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b0993c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652160.147373:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627721344 00000100:00100000:0.0:1788652160.147382:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627721344 00000100:00100000:0.0:1788652160.147459:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788652160.147468:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6800:x1875537627721344:12345-0@lo:5: 00002000:00080000:0.0:1788652160.155897:0:6680:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788652160.155925:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1788652160.164264:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6800:x1875537627721344:12345-0@lo:5: Request processed in 16786us (17107us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788652160.164287:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788652160.164418:0:6800:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe759a8380 x1875537627721344/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788652176 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652160.164433:0:6800:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788652160.164449:0:6800:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cbe759a8380 x1875537627721344/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788652176 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652160.164461:0:6800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6800:1875537627721344:0@lo:5: 00000004:00080000:0.0:1788652160.164476:0:6800:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1788652160.264939:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652161.300902:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652162.320498:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652163.336340:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652164.364394:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788652164.609989:0:7047:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788652165.257581:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875537627721728:0@lo:400: 00000100:00100000:2.0:1788652165.257657:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652165.257721:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788652165.257729:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875537627721600:0@lo:400: 00000100:00100000:2.0:1788652165.257753:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652165.257942:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627721728 00000100:00100000:2.0:1788652165.257951:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627721728 00000100:00100000:2.0:1788652165.258003:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627721600 00000100:00100000:2.0:1788652165.258006:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627721600 00000100:00100000:2.0:1788652165.258029:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788652165.258038:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875537627721728:12345-0@lo:400: 00000100:00100000:2.0:1788652165.258093:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875537627721728:12345-0@lo:400: Request processed in 56us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652165.258101:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788652165.258118:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788652165.258124:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875537627721600:12345-0@lo:400: 00000100:00100000:2.0:1788652165.258150:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875537627721600:12345-0@lo:400: Request processed in 27us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652165.258157:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788652165.258721:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe759a9f80 x1875537627721600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652165.258738:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875537627721600:0@lo:400: 00010000:00080000:2.0:1788652165.258750:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe759aa680 x1875537627721728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652165.258758:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875537627721728:0@lo:400: 00000100:00080000:0.0:1788652165.265841:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652165.266961:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627721472:0@lo:400: 00000100:00100000:3.0:1788652165.267027:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652165.267068:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627721984:0@lo:13: 00000100:00100000:3.0:1788652165.267095:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652165.267122:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788652165.267128:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627721856:0@lo:400: 00000100:00100000:1.0:1788652165.270541:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627721472 00000100:00100000:1.0:1788652165.270644:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627721472 00000100:00100000:1.0:1788652165.270704:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788652165.270714:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+16:3304:x1875537627721472:12345-0@lo:400: 00000100:00100000:1.0:1788652165.270818:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+16:3304:x1875537627721472:12345-0@lo:400: Request processed in 106us (3790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652165.270825:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788652165.271542:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652165.271602:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627721472:0@lo:400: 00000100:00100000:3.0:1788652165.271682:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627721984 00000100:00100000:3.0:1788652165.271687:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627721984 00000100:00100000:3.0:1788652165.271729:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788652165.271735:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875537627721984:12345-0@lo:13: 00002000:00000024:3.0:1788652165.271763:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652165.271823:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875537627721984:12345-0@lo:13: Request processed in 88us (4728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652165.271829:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788652165.271849:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627721856 00000100:00100000:3.0:1788652165.271852:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627721856 00000100:00100000:3.0:1788652165.271874:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788652165.271897:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875537627721856:12345-0@lo:400: 00000100:00100000:3.0:1788652165.271929:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875537627721856:12345-0@lo:400: Request processed in 50us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652165.271935:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788652165.271973:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe759ab100 x1875537627721856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652165.271985:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627721856:0@lo:400: 00010000:00080000:3.0:1788652165.271996:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe7a8b4e00 x1875537627721984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652165.272009:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627721984:0@lo:13: 00000100:00080000:3.0:1788652165.272033:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788652165.380055:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788652165.387591:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652166.407936:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652167.433011:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652168.459549:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652169.495304:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652170.376901:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b191880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627722112:0@lo:400: 00000100:00100000:1.0:1788652170.376974:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652170.377045:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788652170.377052:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875537627722240:0@lo:400: 00000100:00100000:1.0:1788652170.377079:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652170.377111:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627722368:0@lo:400: 00000100:00100000:1.0:1788652170.377134:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652170.377153:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788652170.377158:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627722496:0@lo:400: 00000100:00100000:1.0:1788652170.377181:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652170.377214:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627722112 00000100:00100000:1.0:1788652170.377222:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627722112 00000100:00100000:1.0:1788652170.377265:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788652170.377273:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+16:3305:x1875537627722112:12345-0@lo:400: 00000100:00100000:1.0:1788652170.377318:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+16:3305:x1875537627722112:12345-0@lo:400: Request processed in 46us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652170.377325:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788652170.377356:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627722240 00000100:00100000:1.0:1788652170.377359:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627722240 00000100:00100000:1.0:1788652170.377381:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627722368 00000100:00100000:1.0:1788652170.377384:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627722368 00000100:00100000:1.0:1788652170.377410:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788652170.377416:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875537627722240:12345-0@lo:400: 00000100:00100000:1.0:1788652170.377459:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875537627722240:12345-0@lo:400: Request processed in 43us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652170.377465:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788652170.377478:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788652170.377484:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627722368:12345-0@lo:400: 00000100:00100000:1.0:1788652170.377527:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627722368:12345-0@lo:400: Request processed in 44us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652170.377533:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788652170.377556:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627722496 00000100:00100000:1.0:1788652170.377560:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627722496 00000100:00100000:1.0:1788652170.377586:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788652170.377593:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627722496:12345-0@lo:400: 00000100:00100000:1.0:1788652170.377622:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627722496:12345-0@lo:400: Request processed in 30us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652170.377627:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788652170.377646:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788652170.377650:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788652170.377681:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe4b190700 x1875537627722496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652170.377693:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788652170.377710:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627722496:0@lo:400: 00010000:00080000:1.0:1788652170.377722:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe4b192300 x1875537627722368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652170.377731:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627722368:0@lo:400: 00010000:00080000:1.0:1788652170.377753:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe4b190a80 x1875537627722240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652170.377761:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875537627722240:0@lo:400: 00000100:00100000:1.0:1788652170.377768:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b191880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627722112:0@lo:400: 00000100:00100000:2.0:1788652170.385851:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627722624:0@lo:13: 00000100:00100000:2.0:1788652170.385923:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652170.386169:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627722624 00000100:00100000:0.0:1788652170.386177:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627722624 00000100:00100000:0.0:1788652170.386225:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788652170.386234:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627722624:12345-0@lo:13: 00002000:00000024:0.0:1788652170.386270:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788652170.386324:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627722624:12345-0@lo:13: Request processed in 90us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652170.386331:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788652170.386374:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe7a8b4e00 x1875537627722624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652170.386393:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627722624:0@lo:13: 00010000:00010000:0.0:1788652170.505897:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652171.528006:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652172.552448:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652173.579545:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652174.600027:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652175.496551:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627723136:0@lo:400: 00000100:00100000:2.0:1788652175.496626:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652175.496680:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788652175.496686:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627722752:0@lo:400: 00000100:00100000:2.0:1788652175.496712:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652175.496738:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627722880:0@lo:400: 00000100:00100000:2.0:1788652175.496760:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652175.496806:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788652175.496812:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627723008:0@lo:400: 00000100:00100000:2.0:1788652175.496832:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652175.496861:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627723136 00000100:00100000:2.0:1788652175.496868:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627723136 00000100:00100000:2.0:1788652175.496919:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788652175.496934:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627723136:12345-0@lo:400: 00000100:00100000:2.0:1788652175.496981:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627723136:12345-0@lo:400: Request processed in 55us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652175.496993:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788652175.497014:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627722880 00000100:00100000:2.0:1788652175.497017:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627722880 00000100:00100000:2.0:1788652175.497056:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627723008 00000100:00100000:2.0:1788652175.497059:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627723008 00000100:00100000:2.0:1788652175.497078:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788652175.497085:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627722880:12345-0@lo:400: 00000100:00100000:2.0:1788652175.497118:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627722880:12345-0@lo:400: Request processed in 34us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652175.497124:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788652175.497135:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788652175.497141:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627723008:12345-0@lo:400: 00000100:00100000:2.0:1788652175.497166:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627723008:12345-0@lo:400: Request processed in 27us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652175.497172:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788652175.497190:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788652175.497194:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788652175.497225:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe759a9180 x1875537627723008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652175.497238:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627723008:0@lo:400: 00010000:00080000:2.0:1788652175.497248:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe759a9c00 x1875537627722880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652175.497255:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627722880:0@lo:400: 00010000:00080000:2.0:1788652175.497282:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe759a9880 x1875537627723136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652175.497290:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627723136:0@lo:400: 00000100:00100000:1.0:1788652175.498080:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627722752 00000100:00100000:1.0:1788652175.498089:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627722752 00000100:00100000:1.0:1788652175.498133:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788652175.498657:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627723264:0@lo:13: 00000100:00100000:2.0:1788652175.498703:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652175.498754:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627723264 00000100:00100000:2.0:1788652175.498758:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627723264 00000100:00100000:2.0:1788652175.498813:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788652175.498821:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627723264:12345-0@lo:13: 00002000:00000024:2.0:1788652175.498851:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788652175.498889:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627723264:12345-0@lo:13: Request processed in 69us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652175.498896:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788652175.499030:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+16:3305:x1875537627722752:12345-0@lo:400: 00000100:00100000:1.0:1788652175.499071:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+16:3305:x1875537627722752:12345-0@lo:400: Request processed in 931us (2357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652175.499077:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1788652175.500858:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe759a9880 x1875537627723264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652175.500880:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627723264:0@lo:13: 00000100:00100000:2.0:1788652175.500920:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627722752:0@lo:400: 00010000:00010000:2.0:1788652175.624035:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788652176.071312:0:7614:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788652176.071316:0:7614:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788652176.071467:0:7614:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cbe7fdf4800 00000020:01000004:1.0:1788652176.071481:0:7614:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788652176.071493:0:7614:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788652176.071505:0:7614:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8cbe471799c0) 00000020:00000080:1.0:1788652176.071520:0:7614:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788652176.090378:0:7614:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788652176.090640:0:7614:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788652176.112373:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788652176.127674:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788652176.127706:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788652176.127764:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788652176.127841:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788652176.128644:0:7614:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788652176.128669:0:7614:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788652176.128681:0:7614:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x340ed74ef02a7424 00000020:01000004:2.0:1788652176.128690:0:7614:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788652176.128713:0:7614:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.150@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788652176.128717:0:7614:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788652176.128723:0:7614:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788652176.128746:0:7614:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788652176.128751:0:7614:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.150@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788652176.170122:0:7614:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.150@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788652176.170232:0:7614:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.150@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788652176.170237:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788652176.170239:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788652176.170240:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788652176.170241:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788652176.170242:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788652176.170244:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788652176.170245:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788652176.170246:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788652176.170248:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788652176.170249:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788652176.170251:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788652176.170255:0:7614:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788652176.170257:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788652176.170265:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788652176.170266:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788652176.170267:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788652176.170267:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788652176.170269:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788652176.170270:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788652176.170271:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788652176.170271:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788652176.170272:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788652176.170273:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788652176.170301:0:7614:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788652176.170319:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627723392:0@lo:253: 00000100:00100000:3.0:1788652176.170401:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652176.170565:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe50733300 going to sleep for 11 seconds 00000100:00100000:1.0:1788652176.170720:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627723392 00000100:00100000:1.0:1788652176.170728:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627723392 00000100:00100000:1.0:1788652176.171064:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788652176.171075:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+16:7614:x1875537627723392:12345-0@lo:253: 20000000:01000000:1.0:1788652176.171119:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788652176.171134:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788652176.171140:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788652176.171143:0:5830:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788652176.172432:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788652176.173006:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788652176.173024:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788652176.173070:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788652176.173081:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788652176.173115:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788652176.173252:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788652176.174055:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788652176.174080:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.150@tcp 20000000:01000000:1.0:1788652176.174082:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.150@tcp (null) (null) (null) 00000040:00080000:1.0:1788652176.174117:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788652176.174203:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788652176.174274:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788652176.174283:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.150@tcp (null) (null) 00000040:00080000:1.0:1788652176.174319:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788652176.174329:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788652176.174360:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788652176.174425:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788652176.175864:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1788652176.175893:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.150@tcp 20000000:01000000:1.0:1788652176.175895:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.150@tcp (null) (null) (null) 00000040:00080000:1.0:1788652176.175933:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1788652176.176000:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788652176.176050:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1788652176.176058:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.150@tcp (null) (null) 00000040:00080000:1.0:1788652176.176086:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1788652176.176094:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788652176.176218:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1788652176.176261:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1788652176.176279:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1788652176.176282:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1788652176.176289:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788652176.176291:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788652176.176293:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788652176.176306:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788652176.176309:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788652176.176344:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788652176.176347:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788652176.177428:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788652176.177617:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788652176.177733:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1788652176.178292:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1788652176.178342:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1788652176.178412:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1788652176.178427:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788652176.178429:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788652176.179248:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788652176.179564:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788652176.179603:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788652176.179736:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788652176.179749:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788652176.179751:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788652176.180731:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788652176.180873:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788652176.180932:0:7618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788652176.181371:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788652176.181422:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788652176.181451:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1788652176.181554:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788652176.181558:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788652176.182244:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1788652176.182302:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1788652176.182356:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788652176.183040:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788652176.183085:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788652176.183244:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:3.0:1788652176.183265:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788652176.183285:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbe4151a800/0x340ed74ef02a742b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652176.183305:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe4151a200/0x340ed74ef02a737c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a7375 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652176.183312:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe52924200/0x340ed74ef02a73a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a739f expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652176.183319:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a73d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a73c9 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652176.183337:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe49e56800/0x340ed74ef02a73ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a73e5 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652176.183343:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe49e57000/0x340ed74ef02a7416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a740f expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652176.183351:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbe4151a800/0x340ed74ef02a742b lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652176.183396:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe49e57000/0x340ed74ef02a7416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a740f expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652176.183409:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe49e57000/0x340ed74ef02a7416 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a740f expref: 16 pid: 5828 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652176.183423:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875537627723520:0@lo:104: 00000100:00100000:3.0:1788652176.184057:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788652176.184173:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe49e56800/0x340ed74ef02a73ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a73e5 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652176.184184:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe49e56800/0x340ed74ef02a73ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a73e5 expref: 16 pid: 5829 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652176.184195:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875537627723648:0@lo:104: 00010000:00010000:3.0:1788652176.184222:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a73d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a73c9 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652176.184231:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a73d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a73c9 expref: 16 pid: 5830 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652176.184254:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875537627723776:0@lo:104: 00010000:00010000:3.0:1788652176.184282:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe52924200/0x340ed74ef02a73a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a739f expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652176.184290:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe52924200/0x340ed74ef02a73a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a739f expref: 16 pid: 5830 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652176.184298:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875537627723904:0@lo:104: 00010000:00010000:3.0:1788652176.184321:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe4151a200/0x340ed74ef02a737c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a7375 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652176.184328:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe4151a200/0x340ed74ef02a737c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a7375 expref: 16 pid: 5829 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652176.184337:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875537627724032:0@lo:104: 00000100:00100000:3.0:1788652176.184353:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe50733780 going to sleep for 11 seconds 00000100:00100000:1.0:1788652176.184616:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788652176.184637:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652176.184671:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652176.184679:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652176.184688:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652176.184699:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627723520 00000100:00100000:1.0:1788652176.184705:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627723520 00000100:00100000:1.0:1788652176.184738:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627723648 00000100:00100000:1.0:1788652176.184741:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627723648 00000100:00100000:1.0:1788652176.184751:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627723776 00000100:00100000:1.0:1788652176.184753:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627723776 00000100:00100000:1.0:1788652176.184762:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627723904 00000100:00100000:1.0:1788652176.184764:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627723904 00000100:00100000:1.0:1788652176.184855:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627724032 00000100:00100000:1.0:1788652176.184859:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627724032 00000100:00100000:1.0:1788652176.184874:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788652176.184882:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51350c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+7:5830:x1875537627723520:12345-0@lo:104: 00010000:00010000:1.0:1788652176.184895:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a740f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a7416 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.185114:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1788652176.185198:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652176.185205:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a740f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a7416 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.185213:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e57c00 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:2.0:1788652176.185217:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a740f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a7416 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.185226:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a740f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a7416 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652176.185234:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a740f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a7416 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652176.185240:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788652176.185269:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a740f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7416 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.185275:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652176.185289:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a740f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7416 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.185296:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a740f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7416 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.185306:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652176.185308:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652176.185318:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652176.185338:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627724160:0@lo:103: 00000100:00100000:2.0:1788652176.185366:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652176.185428:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51350c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+7:5830:x1875537627723520:12345-0@lo:104: Request processed in 241us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652176.185438:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788652176.185531:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788652176.185539:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b191880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+6:5830:x1875537627723648:12345-0@lo:104: 00010000:00010000:1.0:1788652176.185552:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57600/0x340ed74ef02a73e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a73ec expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.185591:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788652176.185596:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b191880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+6:5830:x1875537627723648:12345-0@lo:104: Request processed in 59us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652176.185602:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788652176.185614:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788652176.185619:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b190a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+5:5830:x1875537627723776:12345-0@lo:104: 00010000:00010000:1.0:1788652176.185626:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56c00/0x340ed74ef02a73c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a73d0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.185709:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788652176.185715:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b190a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+5:5830:x1875537627723776:12345-0@lo:104: Request processed in 95us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652176.185720:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788652176.185732:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788652176.185737:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b192300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+4:5830:x1875537627723904:12345-0@lo:104: 00010000:00010000:1.0:1788652176.185745:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a739f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a73a6 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.185796:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788652176.185802:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b192300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+4:5830:x1875537627723904:12345-0@lo:104: Request processed in 64us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652176.185807:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788652176.185819:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788652176.185825:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b190700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+3:5830:x1875537627724032:12345-0@lo:104: 00010000:00010000:1.0:1788652176.185837:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe52924e00/0x340ed74ef02a7375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a737c expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.185862:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788652176.185867:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b190700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+3:5830:x1875537627724032:12345-0@lo:104: Request processed in 42us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652176.185872:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788652176.186040:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875537627723520:0@lo:104: 00000100:00100000:3.0:1788652176.186048:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875537627723648:0@lo:104: 00000100:00100000:3.0:1788652176.186054:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875537627723776:0@lo:104: 00000100:00100000:3.0:1788652176.186060:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875537627723904:0@lo:104: 00000100:00100000:3.0:1788652176.186066:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875537627724032:0@lo:104: 00010000:00010000:3.0:1788652176.186090:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbe4151a800/0x340ed74ef02a742b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.186155:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788652176.186161:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57600/0x340ed74ef02a73e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a73ec expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.186167:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e57600 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:2.0:1788652176.186171:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57600/0x340ed74ef02a73e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a73ec expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.186178:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57600/0x340ed74ef02a73e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a73ec expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652176.186185:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57600/0x340ed74ef02a73e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a73ec expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652176.186191:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788652176.186217:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57600/0x340ed74ef02a73e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a73ec expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.186224:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652176.186234:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57600/0x340ed74ef02a73e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a73ec expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.186241:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57600/0x340ed74ef02a73e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a73ec expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.186251:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788652176.186253:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56c00/0x340ed74ef02a73c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a73d0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.186269:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e56c00 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:2.0:1788652176.186272:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56c00/0x340ed74ef02a73c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a73d0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.186279:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56c00/0x340ed74ef02a73c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a73d0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652176.186285:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56c00/0x340ed74ef02a73c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a73d0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652176.186290:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788652176.186301:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56c00/0x340ed74ef02a73c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a73d0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.186307:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652176.186317:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56c00/0x340ed74ef02a73c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a73d0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.186324:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56c00/0x340ed74ef02a73c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a73d0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.186332:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788652176.186334:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a739f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a73a6 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.186340:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151a600 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:2.0:1788652176.186343:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a739f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a73a6 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.186361:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a739f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a73a6 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652176.186368:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a739f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a73a6 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652176.186373:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788652176.186393:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a739f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a73a6 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.186399:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652176.186405:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a739f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a73a6 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.186411:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a739f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a73a6 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.186420:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652176.186423:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe52924e00/0x340ed74ef02a7375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a737c expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.186428:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe52924e00 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:2.0:1788652176.186431:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe52924e00/0x340ed74ef02a7375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a737c expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.186439:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe52924e00/0x340ed74ef02a7375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a737c expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652176.186445:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe52924e00/0x340ed74ef02a7375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a737c expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652176.186454:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788652176.186706:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627724160 00000100:00100000:1.0:1788652176.186712:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627724160 00010000:00010000:1.0:1788652176.186736:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe49e57000/0x340ed74ef02a7416 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a740f expref: 17 pid: 5828 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652176.186832:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788652176.186840:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+17:3303:x1875537627724160:12345-0@lo:103: 00010000:00010000:1.0:1788652176.186851:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652176.186856:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe49e57000/0x340ed74ef02a7416 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a740f expref: 17 pid: 5828 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.186867:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe49e57000/0x340ed74ef02a7416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a740f expref: 17 pid: 5828 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.186881:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe49e57000/0x340ed74ef02a7416 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a740f expref: 17 pid: 5828 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.186895:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652176.186929:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+16:3303:x1875537627724160:12345-0@lo:103: Request processed in 91us (1562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652176.186935:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788652176.187043:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe52924e00/0x340ed74ef02a7375 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a737c expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.187050:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652176.187057:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe52924e00/0x340ed74ef02a7375 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a737c expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.187064:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe52924e00/0x340ed74ef02a7375 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a737c expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.187077:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652176.187079:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652176.187081:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652176.187092:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627724416:0@lo:103: 00000100:00100000:2.0:1788652176.187143:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652176.187365:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788652176.187372:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627724544:0@lo:103: 00000100:00100000:2.0:1788652176.187413:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652176.187472:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627724416 00000100:00100000:3.0:1788652176.187481:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627724416 00010000:00010000:3.0:1788652176.187496:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a73d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a73c9 expref: 16 pid: 5830 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652176.187511:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788652176.187516:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a407100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f811a652-691e-4a40-b660-977a4758dd08+16:3305:x1875537627724416:12345-0@lo:103: 00010000:00010000:3.0:1788652176.187524:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652176.187527:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a73d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a73c9 expref: 16 pid: 5830 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652176.187536:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a73d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a73c9 expref: 16 pid: 5830 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652176.187547:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a73d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a73c9 expref: 16 pid: 5830 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652176.187557:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652176.187580:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a407100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f811a652-691e-4a40-b660-977a4758dd08+15:3305:x1875537627724416:12345-0@lo:103: Request processed in 64us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652176.187586:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1788652176.187795:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652176.187864:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627724416:0@lo:103: 00000100:00100000:2.0:1788652176.187889:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627724288:0@lo:103: 00000100:00100000:2.0:1788652176.187909:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652176.187930:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788652176.187935:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627724672:0@lo:103: 00000100:00100000:2.0:1788652176.187959:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652176.187981:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627724160:0@lo:103: 00000100:00100000:1.0:1788652176.188076:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627724544 00000100:00100000:1.0:1788652176.188080:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627724544 00010000:00010000:1.0:1788652176.188097:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe52924200/0x340ed74ef02a73a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a739f expref: 15 pid: 5830 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652176.188109:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627724288 00000100:00100000:1.0:1788652176.188111:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627724288 00010000:00010000:1.0:1788652176.188118:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe49e56800/0x340ed74ef02a73ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a73e5 expref: 16 pid: 5829 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652176.188137:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627724672 00000100:00100000:1.0:1788652176.188139:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627724672 00010000:00010000:1.0:1788652176.188147:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe4151a200/0x340ed74ef02a737c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a7375 expref: 17 pid: 5829 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652176.188157:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788652176.188162:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a406d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+17:3305:x1875537627724544:12345-0@lo:103: 00010000:00010000:1.0:1788652176.188170:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652176.188174:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe52924200/0x340ed74ef02a73a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a739f expref: 17 pid: 5830 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.188183:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe52924200/0x340ed74ef02a73a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a739f expref: 17 pid: 5830 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.188193:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe52924200/0x340ed74ef02a73a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a739f expref: 17 pid: 5830 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.188203:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652176.188237:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a406d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+16:3305:x1875537627724544:12345-0@lo:103: Request processed in 74us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652176.188242:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788652176.188259:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788652176.188264:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a407800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+15:3304:x1875537627724288:12345-0@lo:103: 00010000:00010000:1.0:1788652176.188271:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652176.188275:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe49e56800/0x340ed74ef02a73ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a73e5 expref: 15 pid: 5829 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.188285:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe49e56800/0x340ed74ef02a73ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a73e5 expref: 15 pid: 5829 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.188294:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe49e56800/0x340ed74ef02a73ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a73e5 expref: 15 pid: 5829 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.188303:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652176.188328:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a407800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+14:3304:x1875537627724288:12345-0@lo:103: Request processed in 63us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652176.188333:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788652176.188343:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788652176.188348:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a405500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+13:3304:x1875537627724672:12345-0@lo:103: 00010000:00010000:1.0:1788652176.188355:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652176.188358:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe4151a200/0x340ed74ef02a737c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a7375 expref: 13 pid: 5829 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.188367:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe4151a200/0x340ed74ef02a737c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a7375 expref: 13 pid: 5829 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.188376:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe4151a200/0x340ed74ef02a737c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a7375 expref: 13 pid: 5829 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.188398:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbe4151a800/0x340ed74ef02a742b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.188416:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe4151a800/0x340ed74ef02a742b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.188431:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe4151a800/0x340ed74ef02a742b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.188439:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe4151a800/0x340ed74ef02a742b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.188445:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbe4151a800/0x340ed74ef02a742b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.188451:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbe4151a800/0x340ed74ef02a742b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.188457:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151a800 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:1.0:1788652176.188474:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbe4151a800/0x340ed74ef02a742b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.188482:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbe4151a800/0x340ed74ef02a742b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.188496:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbe4151a800/0x340ed74ef02a742b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.188505:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652176.188529:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a405500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+12:3304:x1875537627724672:12345-0@lo:103: Request processed in 180us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652176.188535:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788652176.188564:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627724672:0@lo:103: 00000100:00100000:1.0:1788652176.188578:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627724288:0@lo:103: 00010000:00010000:1.0:1788652176.188597:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbe4151a800/0x340ed74ef02a742b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.188604:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbe4151a800/0x340ed74ef02a742b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.188610:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe4151a800/0x340ed74ef02a742b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788652176.188622:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788652176.189520:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627724544:0@lo:103: 00000100:00100000:3.0:1788652176.234316:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+11:7614:x1875537627723392:12345-0@lo:253: Request processed in 63230us (63901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652176.234333:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788652176.234423:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627723392:0@lo:253: 10000000:01000000:1.0:1788652176.234439:0:7614:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788652176.234443:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788652176.234444:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788652176.234446:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788652176.234447:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788652176.234449:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788652176.234450:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788652176.234451:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788652176.234453:0:7614:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788652176.234454:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788652176.234455:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788652176.234474:0:7614:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cbe7fdf4800 from lustre-OST0001 10000000:01000000:1.0:1788652176.234496:0:7614:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788652176.234499:0:7614:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788652176.234506:0:7614:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cbe4b174d40 local copy 10000000:01000000:1.0:1788652176.234510:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788652176.234545:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52924200/0x340ed74ef02a7432 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.234557:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.150@tcp lock: ffff8cbe52924200/0x340ed74ef02a7432 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.234582:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe52924200/0x340ed74ef02a7432 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652176.234602:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627724800:0@lo:101: 00000100:00100000:1.0:1788652176.234640:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652176.235143:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe47da4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788652176.235265:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627724800 00000100:00100000:2.0:1788652176.235272:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627724800 00000100:00100000:3.0:1788652176.235405:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788652176.235415:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+11:7614:x1875537627724800:12345-0@lo:101: 00010000:00010000:3.0:1788652176.235428:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652176.235444:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a7439 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a7432 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652176.235467:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a7439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a7432 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652176.235487:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a7439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a7432 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652176.235496:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe4151ac00, rc 0) 00000100:00100000:3.0:1788652176.235540:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+12:7614:x1875537627724800:12345-0@lo:101: Request processed in 127us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652176.235546:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788652176.235611:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627724800:0@lo:101: 00010000:00010000:1.0:1788652176.235626:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe52924200/0x340ed74ef02a7432 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x340ed74ef02a7439 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.235635:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe52924200/0x340ed74ef02a7432 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x340ed74ef02a7439 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652176.235741:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627724928:0@lo:501: 00000100:00100000:1.0:1788652176.235768:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652176.235972:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe47da4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788652176.236153:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627724928 00000100:00100000:2.0:1788652176.236159:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627724928 00000100:00100000:2.0:1788652176.236185:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788652176.236193:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:7614:x1875537627724928:12345-0@lo:501: 00000100:00100000:2.0:1788652176.236412:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:7614:x1875537627724928:12345-0@lo:501: Request processed in 220us (643us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788652176.236420:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788652176.236564:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627724928:0@lo:501: 10000000:01000000:1.0:1788652176.236579:0:7614:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788652176.236606:0:7614:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788652176.236612:0:7614:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52924200/0x340ed74ef02a7432 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x340ed74ef02a7439 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.236621:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52924200/0x340ed74ef02a7432 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x340ed74ef02a7439 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.236628:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8cbe52924200/0x340ed74ef02a7432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x340ed74ef02a7439 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.236666:0:7614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788652176.236686:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cbe7fdf4800 10000000:01000000:1.0:1788652176.236691:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788652176.236697:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788652176.236700:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788652176.236704:0:7614:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788652176.236707:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788652176.236727:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52925c00/0x340ed74ef02a7440 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.236735:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe52925c00/0x340ed74ef02a7440 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.236745:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe52925c00/0x340ed74ef02a7440 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652176.236760:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627725056:0@lo:101: 00000100:00100000:1.0:1788652176.236817:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652176.236838:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe47da46c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788652176.237063:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652176.237070:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe52924200/0x340ed74ef02a7432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x340ed74ef02a7439 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.237077:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe52924200 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:2.0:1788652176.237081:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe52924200/0x340ed74ef02a7432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x340ed74ef02a7439 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.237090:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe52924200/0x340ed74ef02a7432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x340ed74ef02a7439 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652176.237098:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe52924200/0x340ed74ef02a7432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x340ed74ef02a7439 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652176.237104:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788652176.237136:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe52924200/0x340ed74ef02a7432 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x340ed74ef02a7439 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.237143:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652176.237176:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe52924200/0x340ed74ef02a7432 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x340ed74ef02a7439 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.237184:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe52924200/0x340ed74ef02a7432 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x340ed74ef02a7439 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.237197:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652176.237199:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652176.237201:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652176.237209:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788652176.237220:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627725184:0@lo:103: 00000100:00100000:2.0:1788652176.237250:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652176.237282:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627725056 00000100:00100000:2.0:1788652176.237287:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627725056 00000100:00100000:2.0:1788652176.237313:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788652176.237321:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:7614:x1875537627725056:12345-0@lo:101: 00010000:00010000:2.0:1788652176.237330:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652176.237341:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe8215f000/0x340ed74ef02a7447 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a7440 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.237358:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe8215f000/0x340ed74ef02a7447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a7440 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.237369:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe8215f000/0x340ed74ef02a7447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a7440 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.237377:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215f000, rc 0) 00000100:00100000:2.0:1788652176.237416:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+13:7614:x1875537627725056:12345-0@lo:101: Request processed in 95us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652176.237422:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788652176.237460:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627725184 00000100:00100000:2.0:1788652176.237464:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627725184 00000100:00100000:2.0:1788652176.237495:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788652176.237502:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a406a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+13:3303:x1875537627725184:12345-0@lo:103: 00010000:00010000:2.0:1788652176.237511:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652176.237523:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe4151ac00/0x340ed74ef02a7439 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x340ed74ef02a7432 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.237533:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652176.237562:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a406a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+12:3303:x1875537627725184:12345-0@lo:103: Request processed in 60us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652176.237569:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788652176.237597:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627725184:0@lo:103: 00000100:00100000:1.0:1788652176.237831:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627725056:0@lo:101: 00010000:00010000:1.0:1788652176.237845:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe52925c00/0x340ed74ef02a7440 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7447 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.237853:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe52925c00/0x340ed74ef02a7440 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a7447 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652176.237956:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627725312:0@lo:501: 00000100:00100000:1.0:1788652176.237993:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652176.238013:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe47da46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652176.238340:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627725312 00000100:00100000:2.0:1788652176.238346:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627725312 00000100:00100000:2.0:1788652176.238368:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788652176.238375:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:7614:x1875537627725312:12345-0@lo:501: 00000100:00100000:2.0:1788652176.238590:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:7614:x1875537627725312:12345-0@lo:501: Request processed in 215us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652176.238598:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788652176.238823:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627725312:0@lo:501: 00000100:00100000:1.0:1788652176.238855:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627725440:0@lo:503: 00000100:00100000:1.0:1788652176.239042:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652176.239068:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe47da46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652176.239227:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627725440 00000100:00100000:2.0:1788652176.239233:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627725440 00000100:00100000:2.0:1788652176.239302:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788652176.239311:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:7614:x1875537627725440:12345-0@lo:503: 00000100:00100000:2.0:1788652176.239472:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:7614:x1875537627725440:12345-0@lo:503: Request processed in 161us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652176.239480:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788652176.239562:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627725440:0@lo:503: 00000040:00080000:1.0:1788652176.239885:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788652176.239969:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627725568:0@lo:502: 00000100:00100000:1.0:1788652176.240008:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652176.240405:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe47da46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652176.240456:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627725568 00000100:00100000:0.0:1788652176.240463:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627725568 00000100:00100000:0.0:1788652176.240567:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788652176.240575:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+12:7614:x1875537627725568:12345-0@lo:502: 00000100:00100000:0.0:1788652176.240756:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+12:7614:x1875537627725568:12345-0@lo:502: Request processed in 181us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652176.240763:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788652176.240917:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627725568:0@lo:502: 00000040:00080000:1.0:1788652176.241199:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788652176.241249:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788652176.241285:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788652176.241334:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788652176.241370:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788652176.241418:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788652176.241448:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627725696:0@lo:502: 00000100:00100000:1.0:1788652176.241492:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652176.241532:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe47da46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652176.241805:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627725696 00000100:00100000:0.0:1788652176.241811:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627725696 00000100:00100000:0.0:1788652176.241839:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788652176.241847:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+12:7614:x1875537627725696:12345-0@lo:502: 00000100:00100000:0.0:1788652176.242010:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+12:7614:x1875537627725696:12345-0@lo:502: Request processed in 163us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652176.242017:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788652176.242155:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b193100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627725696:0@lo:502: 00000040:00080000:1.0:1788652176.242224:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788652176.242231:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788652176.242885:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788652176.242894:0:7621:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788652176.242901:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652176.242904:0:7621:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788652176.242910:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788652176.242925:0:7621:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8cbe513c0000) 00000020:00000080:2.0:1788652176.243013:0:7621:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788652176.243025:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788652176.243083:0:7621:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbe7fdf4800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788652176.243091:0:7621:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788652176.243099:0:7621:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x340ed74ef02a7455 00010000:00010000:0.0:1788652176.247323:0:7621:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1788652176.247733:0:7621:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788652176.250534:0:7621:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788652176.251117:0:7621:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788652176.256752:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788652176.257616:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788652176.259559:0:7621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788652176.259571:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652176.259577:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652176.259580:0:7621:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788652176.259584:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788652176.259588:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652176.259589:0:7621:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788652176.259593:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788652176.259595:0:7621:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788652176.259641:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652176.259644:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652176.259646:0:7621:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788652176.260265:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788652176.262740:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788652176.262931:0:7614:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788652176.263024:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52925c00/0x340ed74ef02a7440 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7447 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652176.263039:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe52925c00/0x340ed74ef02a7440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7447 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652176.263049:0:7614:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe7fdf4800 from 1 10000000:01000000:3.0:1788652176.263051:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788652176.263092:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b600/0x340ed74ef02a745c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652176.263101:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b600/0x340ed74ef02a745c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652176.263113:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b600/0x340ed74ef02a745c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652176.263247:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627725824:0@lo:101: 00000100:00100000:3.0:1788652176.263316:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652176.263414:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe49d2c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652176.264911:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627725824 00000100:00100000:1.0:1788652176.264922:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627725824 00000100:00100000:1.0:1788652176.266248:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788652176.266264:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+12:7614:x1875537627725824:12345-0@lo:101: 00010000:00010000:1.0:1788652176.266283:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652176.266300:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe52925000/0x340ed74ef02a7463 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a745c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.266330:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe52925000/0x340ed74ef02a7463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a745c expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.266342:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe52925000/0x340ed74ef02a7463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a745c expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.266351:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe52925000, rc 0) 00000100:00100000:1.0:1788652176.266444:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+13:7614:x1875537627725824:12345-0@lo:101: Request processed in 185us (3127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652176.266450:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788652176.266569:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627725824:0@lo:101: 00010000:00010000:2.0:1788652176.266586:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b600/0x340ed74ef02a745c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7463 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.266596:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b600/0x340ed74ef02a745c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a7463 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652176.266724:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627725952:0@lo:501: 00000100:00100000:2.0:1788652176.266785:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652176.269802:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b286540 going to sleep for 11 seconds 00000100:00100000:3.0:1788652176.270019:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627725952 00000100:00100000:3.0:1788652176.270028:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627725952 00000100:00100000:3.0:1788652176.270081:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788652176.270091:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+13:7614:x1875537627725952:12345-0@lo:501: 00000100:00100000:3.0:1788652176.270446:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+13:7614:x1875537627725952:12345-0@lo:501: Request processed in 355us (3675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652176.270455:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788652176.270560:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627725952:0@lo:501: 00000100:00100000:2.0:1788652176.270612:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627726080:0@lo:503: 00000100:00100000:2.0:1788652176.270669:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652176.270688:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b286540 going to sleep for 11 seconds 00000100:00100000:3.0:1788652176.270799:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627726080 00000100:00100000:3.0:1788652176.270804:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627726080 00000100:00100000:3.0:1788652176.270823:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788652176.270829:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+13:7614:x1875537627726080:12345-0@lo:503: 00000100:00100000:3.0:1788652176.271289:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+13:7614:x1875537627726080:12345-0@lo:503: Request processed in 457us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652176.271297:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788652176.271490:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627726080:0@lo:503: 00000040:00080000:2.0:1788652176.272036:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788652176.272101:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627726208:0@lo:502: 00000100:00100000:2.0:1788652176.272220:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652176.272246:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b286540 going to sleep for 11 seconds 00000100:00100000:3.0:1788652176.272309:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627726208 00000100:00100000:3.0:1788652176.272315:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627726208 00000100:00100000:3.0:1788652176.272392:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788652176.272400:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+13:7614:x1875537627726208:12345-0@lo:502: 00000100:00100000:3.0:1788652176.272581:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+13:7614:x1875537627726208:12345-0@lo:502: Request processed in 181us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652176.272588:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788652176.272681:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627726208:0@lo:502: 00000040:00080000:2.0:1788652176.273180:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788652176.273233:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788652176.273260:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627726336:0@lo:502: 00000100:00100000:2.0:1788652176.273298:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652176.273493:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b286540 going to sleep for 11 seconds 00000100:00100000:1.0:1788652176.273537:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627726336 00000100:00100000:1.0:1788652176.273543:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627726336 00000100:00100000:1.0:1788652176.273571:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788652176.273579:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+13:7614:x1875537627726336:12345-0@lo:502: 00000100:00100000:1.0:1788652176.273923:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+13:7614:x1875537627726336:12345-0@lo:502: Request processed in 344us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652176.273931:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788652176.274268:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627726336:0@lo:502: 00000040:00080000:2.0:1788652176.274399:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788652176.274411:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788652176.275089:0:7625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788652176.275099:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652176.275101:0:7625:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788652176.275107:0:7625:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbe7fdf4800 00000020:00000080:1.0:1788652176.275109:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788652176.275204:0:7625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652176.275208:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652176.275209:0:7625:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788652176.275212:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788652176.275368:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788652176.275402:0:7614:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788652176.275470:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b600/0x340ed74ef02a745c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7463 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.275482:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b600/0x340ed74ef02a745c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7463 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652176.275520:0:7614:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788652176.275522:0:7614:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cbe7fdf4800 10000000:01000000:2.0:1788652176.275524:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cbe7fdf4800 10000000:01000000:2.0:1788652176.275528:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788652176.275533:0:7614:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbe7fdf4800 from 1 10000000:01000000:2.0:1788652176.275535:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788652176.275567:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e000/0x340ed74ef02a746a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.275574:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e000/0x340ed74ef02a746a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.275596:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e000/0x340ed74ef02a746a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652176.275616:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627726464:0@lo:101: 00000100:00100000:2.0:1788652176.275748:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652176.275818:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b286cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652176.275922:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627726464 00000100:00100000:1.0:1788652176.275929:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627726464 00000100:00100000:1.0:1788652176.276093:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788652176.276102:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+13:7614:x1875537627726464:12345-0@lo:101: 00010000:00010000:1.0:1788652176.276114:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652176.276228:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a7471 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a746a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.276255:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a7471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a746a expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.276266:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a7471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a746a expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652176.276275:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe52925e00, rc 0) 00000100:00100000:1.0:1788652176.276373:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+14:7614:x1875537627726464:12345-0@lo:101: Request processed in 271us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652176.276380:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788652176.276538:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627726464:0@lo:101: 00010000:00010000:2.0:1788652176.276553:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e000/0x340ed74ef02a746a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7471 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.276562:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e000/0x340ed74ef02a746a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a7471 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652176.276718:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627726592:0@lo:501: 00000100:00100000:2.0:1788652176.276749:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652176.277076:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b286cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652176.277238:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627726592 00000100:00100000:0.0:1788652176.277244:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627726592 00000100:00100000:0.0:1788652176.277297:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788652176.277307:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+14:7614:x1875537627726592:12345-0@lo:501: 00000100:00100000:0.0:1788652176.277561:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+14:7614:x1875537627726592:12345-0@lo:501: Request processed in 255us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652176.277569:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788652176.277748:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627726592:0@lo:501: 00000100:00100000:2.0:1788652176.277812:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627726720:0@lo:503: 00000100:00100000:2.0:1788652176.277857:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652176.277877:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b286cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652176.277934:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627726720 00000100:00100000:0.0:1788652176.278012:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627726720 00000100:00100000:0.0:1788652176.278050:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788652176.278060:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+14:7614:x1875537627726720:12345-0@lo:503: 00000100:00100000:0.0:1788652176.278336:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+14:7614:x1875537627726720:12345-0@lo:503: Request processed in 278us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652176.278353:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788652176.278438:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627726720:0@lo:503: 00000040:00080000:2.0:1788652176.278753:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788652176.278857:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627726848:0@lo:502: 00000100:00100000:2.0:1788652176.278897:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652176.278920:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b286cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652176.279041:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627726848 00000100:00100000:3.0:1788652176.279047:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627726848 00000100:00100000:3.0:1788652176.279082:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788652176.279091:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+14:7614:x1875537627726848:12345-0@lo:502: 00000100:00100000:3.0:1788652176.279272:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+14:7614:x1875537627726848:12345-0@lo:502: Request processed in 183us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652176.279285:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788652176.279423:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627726848:0@lo:502: 00000040:00080000:2.0:1788652176.279798:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788652176.279862:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788652176.279898:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788652176.280010:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788652176.280052:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788652176.280097:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788652176.280262:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788652176.280300:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788652176.280348:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788652176.280381:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788652176.280427:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788652176.280470:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788652176.280501:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788652176.280531:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788652176.280572:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788652176.280603:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788652176.280633:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788652176.281908:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788652176.282405:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788652176.282447:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788652176.282502:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788652176.282539:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788652176.282574:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788652176.282624:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788652176.282745:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788652176.283101:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788652176.283525:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788652176.283568:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1788652176.283605:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788652176.283916:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1788652176.284033:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1788652176.284077:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1788652176.284104:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1788652176.284238:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1788652176.284272:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1788652176.284311:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1788652176.284345:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1788652176.284408:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627726976:0@lo:502: 00000100:00100000:2.0:1788652176.284485:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652176.284568:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b286cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652176.284619:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627726976 00000100:00100000:0.0:1788652176.284626:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627726976 00000100:00100000:0.0:1788652176.284800:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788652176.284811:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+14:7614:x1875537627726976:12345-0@lo:502: 00000100:00100000:0.0:1788652176.285052:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+14:7614:x1875537627726976:12345-0@lo:502: Request processed in 244us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652176.285060:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788652176.285161:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627726976:0@lo:502: 00000040:00080000:2.0:1788652176.285234:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1788652176.285244:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788652176.286009:0:7626:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788652176.286025:0:7626:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8cbe513c19c0) 00000020:00000080:2.0:1788652176.286051:0:7626:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788652176.286245:0:7626:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbe7fdf4800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788652176.286249:0:7626:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbe7fdf4800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788652176.286252:0:7626:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe7fdf4800 3 00010000:00080000:2.0:1788652176.286288:0:7626:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbe81eca800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.150@tcp at head 00010000:00010000:2.0:1788652176.288640:0:7626:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788652176.289310:0:7626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788652176.289346:0:7626:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788652176.289359:0:7626:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x340ed74ef02a747f 00000100:00080000:2.0:1788652176.289368:0:7626:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788652176.289374:0:7626:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cbe81eca800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1788652176.289423:0:7626:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe7a407b80 x1875537627727104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788652176.289476:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875537627727104:0@lo:38: 00000100:00100000:1.0:1788652176.289547:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652176.289655:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627727104 00000100:00100000:3.0:1788652176.289662:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627727104 00000100:00100000:3.0:1788652176.289695:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788652176.289702:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3302:x1875537627727104:12345-0@lo:38: 00010000:00080000:3.0:1788652176.289723:0:6701:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:3.0:1788652176.289754:0:6701:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x340ed74ef02a7486 00000004:00100000:3.0:1788652176.289790:0:6701:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788652176.289820:0:6701:0:(import.c:65:import_set_state_nolock()) ffff8cbe5f853800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788652176.289890:0:7626:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:0.0:1788652176.292113:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:0.0:1788652176.292353:0:7627:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8cbe819e7b80 x1875537627727232/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652176.292365:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7f320000 going to sleep for 0 seconds 00000020:01000000:0.0:1788652176.292835:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788652176.292864:0:7614:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788652176.292890:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e000/0x340ed74ef02a746a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7471 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652176.292901:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e000/0x340ed74ef02a746a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7471 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788652176.293021:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788652176.293023:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788652176.293025:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788652176.293026:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788652176.293028:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788652176.293030:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788652176.293031:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788652176.293033:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788652176.293034:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788652176.293036:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788652176.293043:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788652176.293046:0:7614:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788652176.293049:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788652176.293050:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788652176.293051:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788652176.293052:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788652176.293053:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788652176.293054:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788652176.293055:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788652176.293056:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788652176.293057:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788652176.293057:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788652176.293058:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788652176.293074:0:7614:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788652176.293087:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627727360:0@lo:253: 00000100:00100000:0.0:1788652176.293227:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652176.293269:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627727360 00000100:00100000:0.0:1788652176.293276:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627727360 00000100:00100000:0.0:1788652176.293328:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788652176.293338:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+14:7614:x1875537627727360:12345-0@lo:253: 20000000:01000000:0.0:1788652176.293376:0:5829:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788652176.293401:0:5829:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788652176.298278:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875537627727104:12345-0@lo:38: Request processed in 8565us (8720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652176.298292:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788652176.298430:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875537627727488:0@lo:400: 00000100:00100000:3.0:1788652176.298481:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652176.298508:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788652176.298513:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627727616:0@lo:400: 00000100:00100000:3.0:1788652176.298533:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652176.298555:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627727744:0@lo:400: 00000100:00100000:3.0:1788652176.298576:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652176.298604:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627727488 00000100:00100000:3.0:1788652176.298611:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627727488 00000100:00100000:3.0:1788652176.298641:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627727616 00000100:00100000:3.0:1788652176.298643:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627727616 00000100:00100000:3.0:1788652176.298672:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788652176.298680:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875537627727488:12345-0@lo:400: 00000100:00100000:3.0:1788652176.298722:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875537627727488:12345-0@lo:400: Request processed in 43us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652176.298741:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788652176.298753:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788652176.298760:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627727616:12345-0@lo:400: 00000100:00100000:3.0:1788652176.298802:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627727616:12345-0@lo:400: Request processed in 43us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652176.298808:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788652176.298826:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627727744 00000100:00100000:3.0:1788652176.298829:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627727744 00000100:00100000:3.0:1788652176.298851:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788652176.298857:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627727744:12345-0@lo:400: 00000100:00100000:3.0:1788652176.298887:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627727744:12345-0@lo:400: Request processed in 31us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652176.298893:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788652176.298926:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe7a8b5f80 x1875537627727616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652176.298941:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627727616:0@lo:400: 00010000:00080000:3.0:1788652176.298958:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe7a8b7480 x1875537627727488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652176.298968:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875537627727488:0@lo:400: 00010000:00080000:3.0:1788652176.298997:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe7a8b7100 x1875537627727744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652176.299006:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627727744:0@lo:400: 00000100:00100000:0.0:1788652176.299794:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7f3206c0 going to sleep for 11 seconds 00010000:00080000:1.0:1788652176.304356:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe7a407b80 x1875537627727104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788652186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652176.304373:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788652176.304392:0:3302:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788652176.304402:0:3302:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788652176.304407:0:3302:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788652176.304410:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cbe81eca800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788652176.304419:0:3302:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000002f66b67c): req@ffff8cbe819e7b80 x1875537627727232/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652176.304438:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875537627727104:0@lo:38: 00000100:00100000:0.0:1788652176.304626:0:7627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652176.305270:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7f320000 going to sleep for 11 seconds 00000100:00100000:0.0:1788652176.306160:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627727232 00000100:00100000:0.0:1788652176.306171:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627727232 00000100:00100000:0.0:1788652176.306244:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788652176.306255:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7627:x1875537627727232:12345-0@lo:901: 00000100:00100000:0.0:1788652176.306658:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7627:x1875537627727232:12345-0@lo:901: Request processed in 392us (2019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652176.306667:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788652176.306710:0:7627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe819e7b80 x1875537627727232/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788652192 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652176.306730:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e7b80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7627:1875537627727232:0@lo:901: 00000100:00080000:2.0:1788652176.307332:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:2.0:1788652176.326523:0:5829:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788652176.326540:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788652176.326571:0:5851:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788652176.326576:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788652176.326599:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a748d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.326620:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe49e56600/0x340ed74ef02a73de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a73d7 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.326627:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a748d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.326677:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe49e56600/0x340ed74ef02a73de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a73d7 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.326691:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe49e56600/0x340ed74ef02a73de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a73d7 expref: 14 pid: 5830 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652176.326705:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a405880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1875537627727872:0@lo:104: 00000100:00100000:2.0:1788652176.326800:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652176.326840:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b286780 going to sleep for 11 seconds 00000100:00100000:2.0:1788652176.326863:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627727872 00000100:00100000:2.0:1788652176.326870:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627727872 00000100:00100000:2.0:1788652176.326917:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788652176.326927:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a405180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+3:5851:x1875537627727872:12345-0@lo:104: 00010000:00010000:2.0:1788652176.326938:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a400/0x340ed74ef02a73d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a73de expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.326988:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788652176.326994:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a405180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+3:5851:x1875537627727872:12345-0@lo:104: Request processed in 69us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652176.327008:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788652176.327034:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652176.327040:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a400/0x340ed74ef02a73d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a73de expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.327047:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151a400 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:2.0:1788652176.327051:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a400/0x340ed74ef02a73d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a73de expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.327060:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a400/0x340ed74ef02a73d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a73de expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652176.327067:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a400/0x340ed74ef02a73d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a73de expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652176.327072:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788652176.327099:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a400/0x340ed74ef02a73d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a73de expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.327106:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652176.327121:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a400/0x340ed74ef02a73d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a73de expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.327251:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a400/0x340ed74ef02a73d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a73de expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.327268:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652176.327270:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652176.327271:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652176.327292:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a405c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627728000:0@lo:103: 00000100:00100000:2.0:1788652176.327329:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652176.327362:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627728000 00000100:00100000:2.0:1788652176.327366:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627728000 00010000:00010000:2.0:1788652176.327393:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe49e56600/0x340ed74ef02a73de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a73d7 expref: 15 pid: 5830 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652176.327414:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788652176.327421:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51233450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f811a652-691e-4a40-b660-977a4758dd08+15:3304:x1875537627728000:12345-0@lo:103: 00010000:00010000:2.0:1788652176.327430:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652176.327434:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe49e56600/0x340ed74ef02a73de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a73d7 expref: 15 pid: 5830 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.327443:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe49e56600/0x340ed74ef02a73de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a73d7 expref: 15 pid: 5830 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.327459:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a748d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.327466:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a748d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788652176.327479:0:5822:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002947561s 00010000:00010000:2.0:1788652176.327482:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a748d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.327489:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a748d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.327495:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a748d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.327512:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a748d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.327517:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215f800 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652176.327520:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a748d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.327527:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a748d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.327535:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a748d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.327545:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652176.327573:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51233450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f811a652-691e-4a40-b660-977a4758dd08+15:3304:x1875537627728000:12345-0@lo:103: Request processed in 153us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652176.327579:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788652176.327634:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a405c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627728000:0@lo:103: 00010000:00010000:2.0:1788652176.328001:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe49e56600/0x340ed74ef02a73de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a73d7 expref: 14 pid: 5830 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652176.328011:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a405880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1875537627727872:0@lo:104: 00010000:00010000:2.0:1788652176.328022:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a748d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.328029:0:5851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a748d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.328035:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a748d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652176.328047:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a748d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652176.339519:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+13:7614:x1875537627727360:12345-0@lo:253: Request processed in 46172us (46281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652176.339555:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788652176.339720:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f811a652-691e-4a40-b660-977a4758dd08:7614:1875537627727360:0@lo:253: 10000000:01000000:0.0:1788652176.339738:0:7614:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788652176.339741:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788652176.339743:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788652176.339744:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788652176.339746:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788652176.339747:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788652176.339748:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788652176.339750:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788652176.339751:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788652176.339752:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788652176.339754:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788652176.339755:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788652176.339790:0:7614:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788652176.346479:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788652176.346766:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788652176.347077:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788652176.347352:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788652176.347720:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788652176.348111:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788652176.349502:0:7614:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788652176.556829:0:7614:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788652176.556836:0:7614:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788652176.556870:0:7614:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788652176.556932:0:7614:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.150@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788652176.556960:0:7614:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788652176.556983:0:7614:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788652176.648199:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652177.673009:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652178.696696:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652179.722021:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652180.619604:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627728128:0@lo:13: 00000100:00100000:0.0:1788652180.619708:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652180.621532:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627728128 00000100:00100000:1.0:1788652180.621549:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627728128 00000100:00100000:1.0:1788652180.621630:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788652180.621641:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627728128:12345-0@lo:13: 00000100:00080000:3.0:1788652180.622266:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788652180.624140:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788652180.624337:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627728128:12345-0@lo:13: Request processed in 2691us (4622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652180.624350:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788652180.625327:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a8b7100 x1875537627728128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652180.625424:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627728128:0@lo:13: 00010000:00010000:2.0:1788652180.745932:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652181.648794:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b190380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627728640:0@lo:400: 00000100:00100000:1.0:1788652181.648862:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652181.648941:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788652181.649020:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627728256:0@lo:400: 00000100:00100000:1.0:1788652181.649058:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652181.649078:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627728256 00000100:00100000:1.0:1788652181.649085:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627728768:0@lo:400: 00000100:00100000:0.0:1788652181.649087:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627728256 00000100:00100000:1.0:1788652181.649116:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652181.649153:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788652181.649162:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+13:3305:x1875537627728256:12345-0@lo:400: 00000100:00100000:0.0:1788652181.649214:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+13:3305:x1875537627728256:12345-0@lo:400: Request processed in 53us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652181.649221:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788652181.649334:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627728768 00000100:00100000:1.0:1788652181.649339:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627728768 00000100:00100000:1.0:1788652181.649407:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788652181.649415:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627728768:12345-0@lo:400: 00000100:00100000:1.0:1788652181.649452:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627728768:12345-0@lo:400: Request processed in 39us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652181.649458:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788652181.649491:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627728256:0@lo:400: 00010000:00080000:1.0:1788652181.649504:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbd422cb100 x1875537627728768/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652181.649516:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627728768:0@lo:400: 00000100:00080000:0.0:1788652181.649577:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652181.650356:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627728384:0@lo:400: 00000100:00100000:2.0:1788652181.650400:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652181.650435:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788652181.650441:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627728512:0@lo:400: 00000100:00100000:2.0:1788652181.650463:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652181.650483:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627728384 00000100:00100000:3.0:1788652181.650490:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627728384 00000100:00100000:2.0:1788652181.650491:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627728640 00000100:00100000:2.0:1788652181.650494:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627728640 00000100:00100000:3.0:1788652181.650519:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627728512 00000100:00100000:3.0:1788652181.650521:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627728512 00000100:00100000:2.0:1788652181.650521:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788652181.650528:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627728640:12345-0@lo:400: 00000100:00100000:3.0:1788652181.650544:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788652181.650550:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627728384:12345-0@lo:400: 00000100:00100000:2.0:1788652181.650569:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627728640:12345-0@lo:400: Request processed in 41us (1708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652181.650576:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788652181.650583:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a405880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627728384:12345-0@lo:400: Request processed in 34us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652181.650588:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788652181.650597:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788652181.650634:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe4b190e00 x1875537627728384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652181.650646:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627728384:0@lo:400: 00000100:00080000:3.0:1788652181.650666:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652181.651015:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627728512:12345-0@lo:400: 00000100:00100000:2.0:1788652181.651057:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627728512:12345-0@lo:400: Request processed in 453us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652181.651079:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788652181.651108:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe4b193480 x1875537627728512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652181.651118:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627728512:0@lo:400: 00010000:00080000:1.0:1788652181.653570:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe4b190380 x1875537627728640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652181.653590:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b190380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627728640:0@lo:400: 00010000:00010000:2.0:1788652181.769484:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788652182.757668:0:7970:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788652182.793084:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652183.816212:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788652184.199914:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788652184.199924:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbe818bc800 from 30 10000000:01000000:2.0:1788652184.199931:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788652184.199975:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a7494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652184.199986:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a7494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652184.199998:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a7494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652184.200023:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a407100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627728896:0@lo:101: 00000100:00100000:2.0:1788652184.200092:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652184.200145:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe492f5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788652184.200160:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627728896 00000100:00100000:3.0:1788652184.200183:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627728896 00000100:00100000:3.0:1788652184.200234:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788652184.200243:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+13:5832:x1875537627728896:12345-0@lo:101: 00010000:00010000:3.0:1788652184.200256:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652184.200269:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe4151a400/0x340ed74ef02a749b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a7494 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652184.200294:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe4151a400/0x340ed74ef02a749b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a7494 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652184.200320:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe4151a400/0x340ed74ef02a749b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a7494 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652184.200340:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe4151a400, rc 0) 00000100:00100000:3.0:1788652184.200387:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+14:5832:x1875537627728896:12345-0@lo:101: Request processed in 146us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652184.200394:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788652184.200451:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a407100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627728896:0@lo:101: 00010000:00010000:3.0:1788652184.200466:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a7494 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a749b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652184.200475:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a7494 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a749b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652184.200524:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627729024:0@lo:501: 00000100:00100000:3.0:1788652184.200550:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652184.200565:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788652184.200578:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627729024 00000100:00100000:3.0:1788652184.200581:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627729024 00000100:00100000:3.0:1788652184.200603:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788652184.200610:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+14:5832:x1875537627729024:12345-0@lo:501: 00000100:00100000:3.0:1788652184.205482:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+14:5832:x1875537627729024:12345-0@lo:501: Request processed in 4861us (4920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652184.205496:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788652184.205552:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627729024:0@lo:501: 00000100:00100000:3.0:1788652184.205609:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627729152:0@lo:503: 00000100:00100000:3.0:1788652184.205673:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652184.205703:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788652184.205722:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627729152 00000100:00100000:3.0:1788652184.205728:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627729152 00000100:00100000:3.0:1788652184.205769:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788652184.205794:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+14:5832:x1875537627729152:12345-0@lo:503: 00000100:00100000:3.0:1788652184.206124:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+14:5832:x1875537627729152:12345-0@lo:503: Request processed in 330us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652184.206132:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788652184.206323:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627729152:0@lo:503: 00000100:00100000:0.0:1788652184.209435:0:8042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8042:1875537627729280:0@lo:502: 00000100:00100000:0.0:1788652184.209514:0:8042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652184.209554:0:8042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5eb13f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788652184.210107:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627729280 00000100:00100000:2.0:1788652184.210116:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627729280 00000100:00100000:2.0:1788652184.210161:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788652184.210170:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+14:8042:x1875537627729280:12345-0@lo:502: 00000100:00100000:2.0:1788652184.210537:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+14:8042:x1875537627729280:12345-0@lo:502: Request processed in 367us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652184.210547:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788652184.211022:0:8042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8042:1875537627729280:0@lo:502: 00000100:00100000:3.0:1788652184.211087:0:8042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8042:1875537627729408:0@lo:502: 00000100:00100000:3.0:1788652184.211129:0:8042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652184.211159:0:8042:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb480 going to sleep for 11 seconds 00000100:00100000:3.0:1788652184.213937:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627729408 00000100:00100000:3.0:1788652184.213962:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627729408 00000100:00100000:3.0:1788652184.214021:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788652184.214032:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+14:8042:x1875537627729408:12345-0@lo:502: 00000100:00100000:3.0:1788652184.214322:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+14:8042:x1875537627729408:12345-0@lo:502: Request processed in 291us (3191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652184.214341:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788652184.214611:0:8042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8042:1875537627729408:0@lo:502: 00000040:00080000:1.0:1788652184.214646:0:8042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788652184.214897:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788652184.214919:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788652184.214929:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a7494 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a749b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652184.215039:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a7494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a749b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652184.215049:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788652184.215052:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1788652184.215055:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788652184.215084:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe4151ac00/0x340ed74ef02a74a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652184.215092:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe4151ac00/0x340ed74ef02a74a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652184.215101:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe4151ac00/0x340ed74ef02a74a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652184.215120:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627729536:0@lo:101: 00000100:00100000:3.0:1788652184.215162:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652184.215323:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb000 going to sleep for 11 seconds 00000100:00100000:2.0:1788652184.215434:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627729536 00000100:00100000:2.0:1788652184.215440:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627729536 00000100:00100000:2.0:1788652184.215478:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788652184.215487:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+14:5832:x1875537627729536:12345-0@lo:101: 00010000:00010000:2.0:1788652184.215497:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652184.215509:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe8215e400/0x340ed74ef02a74a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a74a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652184.215529:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe8215e400/0x340ed74ef02a74a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a74a2 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652184.215540:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe8215e400/0x340ed74ef02a74a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a74a2 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652184.215549:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215e400, rc 0) 00000100:00100000:2.0:1788652184.215636:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+15:5832:x1875537627729536:12345-0@lo:101: Request processed in 149us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652184.215643:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788652184.223922:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627729536:0@lo:101: 00010000:00010000:0.0:1788652184.224078:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe4151ac00/0x340ed74ef02a74a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a74a9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652184.224093:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe4151ac00/0x340ed74ef02a74a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a74a9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652184.225348:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a406d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627729664:0@lo:501: 00000100:00100000:2.0:1788652184.225419:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652184.225459:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe492f5600 going to sleep for 11 seconds 00000100:00100000:0.0:1788652184.227702:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627729664 00000100:00100000:0.0:1788652184.227719:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627729664 00000100:00100000:0.0:1788652184.227800:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788652184.227810:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+15:5832:x1875537627729664:12345-0@lo:501: 00000100:00100000:0.0:1788652184.228139:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+15:5832:x1875537627729664:12345-0@lo:501: Request processed in 330us (2719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652184.228148:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788652184.228217:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a406d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627729664:0@lo:501: 00000100:00100000:0.0:1788652184.228264:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627729792:0@lo:503: 00000100:00100000:0.0:1788652184.228315:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652184.228356:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5eb139c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652184.228614:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627729792 00000100:00100000:2.0:1788652184.228620:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627729792 00000100:00100000:2.0:1788652184.228646:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788652184.228654:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+15:5832:x1875537627729792:12345-0@lo:503: 00000100:00100000:2.0:1788652184.229683:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+15:5832:x1875537627729792:12345-0@lo:503: Request processed in 1024us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652184.229694:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788652184.230050:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627729792:0@lo:503: 00000100:00100000:0.0:1788652184.230289:0:8043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8043:1875537627729920:0@lo:502: 00000100:00100000:0.0:1788652184.230351:0:8043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652184.230380:0:8043:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5eb13300 going to sleep for 11 seconds 00000100:00100000:3.0:1788652184.230826:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627729920 00000100:00100000:3.0:1788652184.230834:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627729920 00000100:00100000:3.0:1788652184.230864:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788652184.230871:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+15:8043:x1875537627729920:12345-0@lo:502: 00000100:00100000:3.0:1788652184.231427:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+15:8043:x1875537627729920:12345-0@lo:502: Request processed in 553us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652184.231436:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788652184.233111:0:8043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8043:1875537627729920:0@lo:502: 00000020:01000000:0.0:1788652184.233163:0:8043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788652184.233188:0:8043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652184.233190:0:8043:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788652184.233195:0:8043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788652184.233197:0:8043:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788652184.233233:0:8043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8043:1875537627730048:0@lo:502: 00000100:00100000:0.0:1788652184.233301:0:8043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652184.233357:0:8043:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5eb13300 going to sleep for 11 seconds 00000100:00100000:3.0:1788652184.233464:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627730048 00000100:00100000:3.0:1788652184.233471:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627730048 00000100:00100000:3.0:1788652184.233514:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788652184.233531:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+15:8043:x1875537627730048:12345-0@lo:502: 00000100:00100000:3.0:1788652184.233733:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+15:8043:x1875537627730048:12345-0@lo:502: Request processed in 203us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652184.233742:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788652184.234847:0:8043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8043:1875537627730048:0@lo:502: 00000020:01000000:0.0:1788652184.236863:0:8043:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788652184.236878:0:8043:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652184.236881:0:8043:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788652184.236899:0:8043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1788652184.242094:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788652184.242132:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788652184.242145:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe4151ac00/0x340ed74ef02a74a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a74a9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652184.242158:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe4151ac00/0x340ed74ef02a74a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a74a9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652184.242179:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788652184.242183:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbe50c46000 from 30 10000000:01000000:3.0:1788652184.242186:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788652184.242228:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a800/0x340ed74ef02a74b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652184.242236:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a800/0x340ed74ef02a74b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652184.242247:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a800/0x340ed74ef02a74b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652184.242271:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627730176:0@lo:101: 00000100:00100000:3.0:1788652184.242348:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652184.242401:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb480 going to sleep for 11 seconds 00000100:00100000:1.0:1788652184.242508:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627730176 00000100:00100000:1.0:1788652184.242516:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627730176 00000100:00100000:1.0:1788652184.242563:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788652184.242587:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+15:5832:x1875537627730176:12345-0@lo:101: 00010000:00010000:1.0:1788652184.242600:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652184.242612:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe52924400/0x340ed74ef02a74b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a74b0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652184.242636:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe52924400/0x340ed74ef02a74b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a74b0 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652184.242646:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe52924400/0x340ed74ef02a74b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a74b0 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652184.242654:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe52924400, rc 0) 00000100:00100000:1.0:1788652184.242695:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+16:5832:x1875537627730176:12345-0@lo:101: Request processed in 109us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652184.242701:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788652184.244287:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627730176:0@lo:101: 00010000:00010000:3.0:1788652184.244313:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a800/0x340ed74ef02a74b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a74b7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652184.244342:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a800/0x340ed74ef02a74b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a74b7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652184.244413:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627730304:0@lo:501: 00000100:00100000:3.0:1788652184.244457:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652184.244494:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb480 going to sleep for 11 seconds 00000100:00100000:0.0:1788652184.244560:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627730304 00000100:00100000:0.0:1788652184.244567:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627730304 00000100:00100000:0.0:1788652184.244614:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788652184.244624:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+16:5832:x1875537627730304:12345-0@lo:501: 00000100:00100000:0.0:1788652184.244908:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+16:5832:x1875537627730304:12345-0@lo:501: Request processed in 286us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652184.244916:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788652184.245277:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627730304:0@lo:501: 00000100:00100000:3.0:1788652184.245311:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627730432:0@lo:503: 00000100:00100000:3.0:1788652184.245363:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652184.245830:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb480 going to sleep for 11 seconds 00000100:00100000:1.0:1788652184.249067:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627730432 00000100:00100000:1.0:1788652184.249085:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627730432 00000100:00100000:1.0:1788652184.249145:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788652184.249157:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+16:5832:x1875537627730432:12345-0@lo:503: 00000100:00100000:1.0:1788652184.249404:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+16:5832:x1875537627730432:12345-0@lo:503: Request processed in 250us (4040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652184.249411:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788652184.253240:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627730432:0@lo:503: 00000100:00100000:0.0:1788652184.256684:0:8045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8045:1875537627730560:0@lo:502: 00000100:00100000:0.0:1788652184.256802:0:8045:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652184.256840:0:8045:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5eb13c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788652184.257054:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627730560 00000100:00100000:1.0:1788652184.257063:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627730560 00000100:00100000:1.0:1788652184.257113:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788652184.257123:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+16:8045:x1875537627730560:12345-0@lo:502: 00000100:00100000:1.0:1788652184.257388:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+16:8045:x1875537627730560:12345-0@lo:502: Request processed in 266us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652184.257404:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788652184.257520:0:8045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8045:1875537627730560:0@lo:502: 00000100:00100000:0.0:1788652184.257569:0:8045:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8045:1875537627730688:0@lo:502: 00000100:00100000:0.0:1788652184.257604:0:8045:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652184.257629:0:8045:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5eb13c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788652184.257671:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627730688 00000100:00100000:3.0:1788652184.257676:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627730688 00000100:00100000:3.0:1788652184.257703:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788652184.257709:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+16:8045:x1875537627730688:12345-0@lo:502: 00000100:00100000:3.0:1788652184.257877:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+16:8045:x1875537627730688:12345-0@lo:502: Request processed in 167us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652184.257894:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788652184.258070:0:8045:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8045:1875537627730688:0@lo:502: 00000040:00080000:0.0:1788652184.258090:0:8045:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788652184.258247:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788652184.258274:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788652184.258284:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a800/0x340ed74ef02a74b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a74b7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652184.258294:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a800/0x340ed74ef02a74b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a74b7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652184.258302:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788652184.258311:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbe50c46000 from 5 10000000:01000000:3.0:1788652184.258313:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788652184.258354:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a200/0x340ed74ef02a74be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652184.258362:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a200/0x340ed74ef02a74be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652184.258371:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a200/0x340ed74ef02a74be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652184.258385:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627730816:0@lo:101: 00000100:00100000:3.0:1788652184.258415:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652184.258449:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb240 going to sleep for 11 seconds 00000100:00100000:1.0:1788652184.258501:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627730816 00000100:00100000:1.0:1788652184.258506:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627730816 00000100:00100000:1.0:1788652184.258539:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788652184.258547:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+16:5832:x1875537627730816:12345-0@lo:101: 00010000:00010000:1.0:1788652184.258556:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652184.258570:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe52924800/0x340ed74ef02a74c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a74be expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652184.258592:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe52924800/0x340ed74ef02a74c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a74be expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652184.258602:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe52924800/0x340ed74ef02a74c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a74be expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652184.258610:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe52924800, rc 0) 00000100:00100000:1.0:1788652184.258645:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627730816:12345-0@lo:101: Request processed in 99us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652184.258651:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788652184.258746:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627730816:0@lo:101: 00010000:00010000:3.0:1788652184.258759:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a200/0x340ed74ef02a74be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a74c5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652184.258768:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a200/0x340ed74ef02a74be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a74c5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652184.258841:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627730944:0@lo:256: 00000100:00100000:3.0:1788652184.258868:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652184.258896:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb240 going to sleep for 11 seconds 00000100:00100000:1.0:1788652184.259112:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627730944 00000100:00100000:1.0:1788652184.259117:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627730944 00000100:00100000:1.0:1788652184.259147:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788652184.259154:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627730944:12345-0@lo:256: 20000000:01000000:1.0:1788652184.259167:0:5829:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788652184.259184:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788652184.259187:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788652184.259267:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627730944:12345-0@lo:256: Request processed in 114us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652184.259280:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788652184.259487:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627730944:0@lo:256: 10000000:01000000:3.0:1788652184.259531:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788652184.259538:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a200/0x340ed74ef02a74be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a74c5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652184.259556:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a200/0x340ed74ef02a74be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a74c5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652184.259564:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788652184.259566:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788652184.259568:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788652184.259588:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a74cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652184.259595:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a74cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652184.259603:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a74cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652184.259616:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627731072:0@lo:101: 00000100:00100000:3.0:1788652184.259643:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652184.259674:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb240 going to sleep for 11 seconds 00000100:00100000:0.0:1788652184.259714:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627731072 00000100:00100000:0.0:1788652184.259718:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627731072 00000100:00100000:0.0:1788652184.259747:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788652184.259754:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627731072:12345-0@lo:101: 00010000:00010000:0.0:1788652184.259762:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652184.259797:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe49e56a00/0x340ed74ef02a74d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a74cc expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652184.259816:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe49e56a00/0x340ed74ef02a74d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a74cc expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652184.259825:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe49e56a00/0x340ed74ef02a74d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a74cc expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652184.259832:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e56a00, rc 0) 00000100:00100000:0.0:1788652184.259867:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627731072:12345-0@lo:101: Request processed in 113us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652184.259873:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788652184.260088:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627731072:0@lo:101: 00010000:00010000:3.0:1788652184.260100:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a74cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a74d3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652184.260109:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a74cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a74d3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652184.260153:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627731200:0@lo:501: 00000100:00100000:3.0:1788652184.260190:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652184.260283:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627731200 00000100:00100000:0.0:1788652184.260288:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627731200 00000100:00100000:0.0:1788652184.260314:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788652184.260322:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627731200:12345-0@lo:501: 00000100:00100000:0.0:1788652184.260568:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627731200:12345-0@lo:501: Request processed in 247us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652184.260575:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788652184.260677:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb240 going to sleep for 11 seconds 00000100:00100000:3.0:1788652184.260691:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627731200:0@lo:501: 00000100:00100000:3.0:1788652184.260723:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627731328:0@lo:503: 00000100:00100000:3.0:1788652184.260760:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652184.260800:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb240 going to sleep for 11 seconds 00000100:00100000:0.0:1788652184.261639:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627731328 00000100:00100000:0.0:1788652184.261647:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627731328 00000100:00100000:0.0:1788652184.261689:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788652184.261697:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627731328:12345-0@lo:503: 00000100:00100000:0.0:1788652184.262361:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627731328:12345-0@lo:503: Request processed in 662us (1596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652184.262370:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788652184.262653:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627731328:0@lo:503: 00000100:00100000:0.0:1788652184.263408:0:8046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8046:1875537627731456:0@lo:502: 00000100:00100000:0.0:1788652184.263463:0:8046:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652184.263493:0:8046:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5eb13cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652184.263553:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627731456 00000100:00100000:1.0:1788652184.263559:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627731456 00000100:00100000:1.0:1788652184.263598:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788652184.263606:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+18:8046:x1875537627731456:12345-0@lo:502: 00000100:00100000:2.0:1788652184.264711:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+18:8046:x1875537627731456:12345-0@lo:502: Request processed in 1099us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652184.264723:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788652184.264862:0:8046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8046:1875537627731456:0@lo:502: 00000020:01000000:0.0:1788652184.264902:0:8046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788652184.264910:0:8046:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788652184.264916:0:8046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652184.264919:0:8046:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788652184.264925:0:8046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788652184.264929:0:8046:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.150@tcp to nid 0x20000c0a8cb96 (192.168.203.150@tcp) 00000020:01000000:0.0:1788652184.265113:0:8046:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788652184.265117:0:8046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788652184.265132:0:8046:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8cbe4b1719c0) 00000020:00000080:0.0:1788652184.265155:0:8046:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788652184.265264:0:8046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788652184.265354:0:8046:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788652184.265360:0:8046:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788652184.265367:0:8046:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x340ed74ef02a74e1 00010000:00080000:0.0:1788652184.265396:0:8046:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbe818db800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.150@tcp at head 00010000:00010000:0.0:1788652184.265633:0:8046:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788652184.266402:0:8046:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788652184.266419:0:8046:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788652184.267627:0:8046:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788652184.268027:0:8046:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788652184.268079:0:8046:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788652184.268137:0:8046:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788652184.270467:0:8047:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788652184.270476:0:8047:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788652184.271448:0:8046:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788652184.271461:0:8046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788652184.271501:0:8046:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788652184.271529:0:8046:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x340ed74ef02a74e8 00000100:00080000:0.0:1788652184.271542:0:8046:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788652184.271548:0:8046:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cbe818db800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:0.0:1788652184.271588:0:8046:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe819e5180 x1875537627731584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788652184.271615:0:8046:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788652184.271679:0:8046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788652184.271683:0:8046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652184.271685:0:8046:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788652184.271688:0:8046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788652184.271692:0:8046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652184.271693:0:8046:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788652184.271697:0:8046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788652184.271698:0:8046:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788652184.271728:0:8046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8046:1875537627731712:0@lo:502: 00000100:00100000:0.0:1788652184.271838:0:8046:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652184.271887:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627731712 00000100:00100000:0.0:1788652184.271894:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627731712 00000100:00100000:0.0:1788652184.271930:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788652184.271938:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+18:8046:x1875537627731712:12345-0@lo:502: 00000100:00100000:1.0:1788652184.272455:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875537627731584:0@lo:8: 00000100:00100000:1.0:1788652184.272499:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652184.272558:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627731584 00000100:00100000:1.0:1788652184.272562:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627731584 00000100:00100000:1.0:1788652184.272589:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788652184.272595:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1875537627731584:12345-0@lo:8: 00010000:00080000:1.0:1788652184.272619:0:6678:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:1.0:1788652184.272647:0:6678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x340ed74ef02a74ef 00002000:00100000:1.0:1788652184.272660:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8cbe512cd000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788652184.272664:0:6678:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788652184.272669:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788652184.272816:0:6678:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788652184.273036:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788652184.273062:0:6678:0:(import.c:65:import_set_state_nolock()) ffff8cbe512cc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788652184.273116:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1875537627731584:12345-0@lo:8: Request processed in 519us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652184.273123:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788652184.273167:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe819e5180 x1875537627731584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788652194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652184.273251:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788652184.273260:0:3302:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788652184.273276:0:3302:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788652184.273281:0:3302:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788652184.273284:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cbe818db800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788652184.273291:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788652184.273296:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875537627731584:0@lo:8: 00000100:00100000:0.0:1788652184.273672:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+18:8046:x1875537627731712:12345-0@lo:502: Request processed in 1732us (1832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652184.273679:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788652184.273731:0:8046:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5eb13540 going to sleep for 11 seconds 00000100:00100000:0.0:1788652184.273746:0:8046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8046:1875537627731712:0@lo:502: 00000020:01000000:0.0:1788652184.273791:0:8046:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788652184.273798:0:8046:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652184.273800:0:8046:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788652184.273806:0:8046:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:2.0:1788652184.274134:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875537627731968:0@lo:400: 00000100:00100000:2.0:1788652184.274236:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652184.274262:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788652184.274268:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627731840:0@lo:400: 00000100:00100000:2.0:1788652184.274292:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652184.274318:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875537627732224:0@lo:400: 00000100:00100000:2.0:1788652184.274358:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652184.274375:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788652184.274379:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627732096:0@lo:400: 00000100:00100000:2.0:1788652184.274399:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788652184.274424:0:8047:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788652184.274525:0:8047:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 201257752347ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788652184.274629:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627731968 00000100:00100000:3.0:1788652184.274636:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627731968 00000100:00100000:3.0:1788652184.274687:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627731840 00000100:00100000:3.0:1788652184.274690:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627731840 00000100:00100000:3.0:1788652184.274703:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627732224 00000100:00100000:3.0:1788652184.274705:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627732224 00000100:00100000:3.0:1788652184.274722:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788652184.274730:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875537627731968:12345-0@lo:400: 00000100:00100000:3.0:1788652184.274798:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875537627731968:12345-0@lo:400: Request processed in 68us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652184.274805:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788652184.274819:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788652184.274824:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627731840:12345-0@lo:400: 00000100:00100000:3.0:1788652184.274852:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627731840:12345-0@lo:400: Request processed in 28us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652184.274858:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788652184.274868:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788652184.274874:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875537627732224:12345-0@lo:400: 00000100:00100000:3.0:1788652184.274904:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875537627732224:12345-0@lo:400: Request processed in 30us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652184.274909:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788652184.274956:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627732096 00000100:00100000:3.0:1788652184.274960:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627732096 00000100:00100000:3.0:1788652184.274985:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788652184.274991:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627732096:12345-0@lo:400: 00000100:00100000:3.0:1788652184.275019:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627732096:12345-0@lo:400: Request processed in 29us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652184.275025:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788652184.275060:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a407800 x1875537627731840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652184.275072:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627731840:0@lo:400: 00010000:00080000:3.0:1788652184.275081:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a405500 x1875537627731968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652184.275090:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875537627731968:0@lo:400: 00010000:00080000:3.0:1788652184.275118:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a406a00 x1875537627732096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652184.275125:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627732096:0@lo:400: 00010000:00080000:3.0:1788652184.275138:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a404a80 x1875537627732224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652184.275145:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875537627732224:0@lo:400: 00000100:00080000:2.0:1788652184.275641:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788652184.275648:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:1.0:1788652184.275742:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788652184.275795:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788652184.275806:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a74cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a74d3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652184.275816:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a74cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a74d3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652184.275825:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788652184.275828:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cbe4b174d40 from 1 10000000:01000000:1.0:1788652184.275830:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788652184.275862:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52925200/0x340ed74ef02a74f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652184.275869:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe52925200/0x340ed74ef02a74f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652184.275878:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe52925200/0x340ed74ef02a74f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652184.275908:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627732352:0@lo:101: 00000100:00100000:1.0:1788652184.276064:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652184.276105:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4f1d99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652184.276448:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627732352 00000100:00100000:3.0:1788652184.276454:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627732352 00000100:00100000:3.0:1788652184.277056:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788652184.277067:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627732352:12345-0@lo:101: 00010000:00010000:3.0:1788652184.277083:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652184.277114:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7a0e5c00/0x340ed74ef02a74fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a74f6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652184.277145:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7a0e5c00/0x340ed74ef02a74fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a74f6 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652184.277156:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7a0e5c00/0x340ed74ef02a74fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a74f6 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652184.277165:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5c00, rc 0) 00000100:00100000:3.0:1788652184.277225:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:5832:x1875537627732352:12345-0@lo:101: Request processed in 161us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652184.277231:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788652184.279434:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627732352:0@lo:101: 00010000:00010000:1.0:1788652184.279470:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe52925200/0x340ed74ef02a74f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a74fd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652184.279482:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe52925200/0x340ed74ef02a74f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a74fd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652184.279549:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627732480:0@lo:501: 00000100:00100000:1.0:1788652184.279602:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652184.286142:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4f1d99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652184.292905:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627732480 00000100:00100000:2.0:1788652184.292919:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627732480 00000100:00100000:2.0:1788652184.293088:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788652184.293099:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:5832:x1875537627732480:12345-0@lo:501: 00000100:00100000:2.0:1788652184.293349:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:5832:x1875537627732480:12345-0@lo:501: Request processed in 250us (13745us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788652184.293357:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788652184.293424:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627732480:0@lo:501: 10000000:01000000:2.0:1788652184.293460:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788652184.293471:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52925200/0x340ed74ef02a74f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a74fd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652184.293482:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe52925200/0x340ed74ef02a74f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a74fd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788652184.382755:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788652184.407628:0:8048:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788652184.407664:0:8048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8048:1875537627732736:0@lo:7: 00000100:00100000:0.0:1788652184.407736:0:8048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652184.407822:0:8048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4a5d73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652184.407851:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627732608:0@lo:13: 00000100:00100000:0.0:1788652184.407876:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652184.408617:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627732608 00000100:00100000:3.0:1788652184.408627:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627732608 00000100:00100000:3.0:1788652184.408693:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788652184.408704:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875537627732608:12345-0@lo:13: 00002000:00000024:3.0:1788652184.408737:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788652184.408817:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875537627732608:12345-0@lo:13: Request processed in 115us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652184.408824:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788652184.408870:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe819e5c00 x1875537627732608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652200 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652184.408902:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627732608:0@lo:13: 00000100:00080000:0.0:1788652184.409084:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788652184.409173:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627732736 00000100:00100000:0.0:1788652184.409178:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627732736 00000100:00100000:0.0:1788652184.409216:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788652184.409223:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8048:x1875537627732736:12345-0@lo:7: 00002000:00080000:2.0:1788652184.417527:0:6680:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788652184.417535:0:6680:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788652184.417856:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8048:x1875537627732736:12345-0@lo:7: Request processed in 8528us (10014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652184.417869:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788652184.418217:0:8048:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe819e4a80 x1875537627732736/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788652200 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652184.418232:0:8048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8048:1875537627732736:0@lo:7: 00000004:00080000:0.0:1788652184.418403:0:8048:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788652184.418443:0:8048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8048:1875537627732864:0@lo:5: 00000100:00100000:0.0:1788652184.418481:0:8048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652184.418530:0:8048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe45003d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788652184.418671:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627732864 00000100:00100000:2.0:1788652184.418678:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627732864 00000100:00100000:2.0:1788652184.418722:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788652184.418731:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8048:x1875537627732864:12345-0@lo:5: 00002000:00080000:2.0:1788652184.418833:0:6678:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788652184.418838:0:6678:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788652184.419097:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8048:x1875537627732864:12345-0@lo:5: Request processed in 366us (616us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788652184.419104:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788652184.419273:0:8048:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe819e4a80 x1875537627732864/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788652200 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652184.419286:0:8048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8048:1875537627732864:0@lo:5: 00000004:00080000:0.0:1788652184.419295:0:8048:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788652184.419320:0:8048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8048:1875537627732992:0@lo:700: 00000100:00100000:0.0:1788652184.419354:0:8048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652184.419372:0:8048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe45003d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788652184.419386:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627732992 00000100:00100000:0.0:1788652184.419390:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627732992 00000100:00100000:0.0:1788652184.419414:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788652184.419421:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8048:x1875537627732992:12345-0@lo:700: 00000100:00100000:0.0:1788652184.419447:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6686:1875537627733120:0@lo:700: 00000100:00100000:0.0:1788652184.419471:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652184.419492:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe450036c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652184.420254:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627733120 00000100:00100000:0.0:1788652184.420266:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627733120 00000100:00100000:0.0:1788652184.420396:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788652184.420406:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6686:x1875537627733120:12345-0@lo:700: 40000000:02000000:0.0:1788652184.475162:0:5842:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1788652184.485495:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6686:x1875537627733120:12345-0@lo:700: Request processed in 65083us (66015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652184.485520:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788652184.488916:0:6686:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe819e6d80 x1875537627733120/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788652200 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652184.488934:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6686:1875537627733120:0@lo:700: 40000000:02000000:1.0:1788652184.488950:0:6686:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:0.0:1788652184.577289:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788652184.577312:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1788652184.577514:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8048:x1875537627732992:12345-0@lo:700: Request processed in 158088us (158153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652184.577536:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788652184.577796:0:8048:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe819e4000 x1875537627732992/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788652200 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652184.577808:0:8048:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788652184.577824:0:8048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8048:1875537627732992:0@lo:700: 00000004:02000040:1.0:1788652184.622868:0:8048:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1788652184.637649:0:8048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a404e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8048:1875537627733248:0@lo:5: 00000100:00100000:2.0:1788652184.637727:0:8048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652184.637815:0:8048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5eb13f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788652184.638604:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627733248 00000100:00100000:3.0:1788652184.638614:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627733248 00000100:00100000:3.0:1788652184.638681:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788652184.638692:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8048:x1875537627733248:12345-0@lo:5: 00002000:00080000:2.0:1788652184.670021:0:6680:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788652184.670042:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788652184.685481:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8048:x1875537627733248:12345-0@lo:5: Request processed in 46780us (47742us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788652184.685757:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788652184.685762:0:8048:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a404e00 x1875537627733248/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788652200 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652184.685810:0:8048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a404e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8048:1875537627733248:0@lo:5: 00000004:00080000:1.0:1788652184.685830:0:8048:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1788652184.840076:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652185.736601:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627733376:0@lo:13: 00000100:00100000:1.0:1788652185.736741:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652185.736981:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627733376 00000100:00100000:3.0:1788652185.736991:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627733376 00000100:00100000:3.0:1788652185.737041:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788652185.737051:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627733376:12345-0@lo:13: 00002000:00000024:3.0:1788652185.737082:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652185.737128:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627733376:12345-0@lo:13: Request processed in 79us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652185.737134:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788652185.737174:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a8b5180 x1875537627733376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652185.737191:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627733376:0@lo:13: 00010000:00010000:0.0:1788652185.864954:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652186.891247:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788652187.869257:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1788652187.912935:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652188.471189:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652188.471387:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603592320 00000100:00100000:2.0:1788652188.471407:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603592320 00000100:00100000:2.0:1788652188.471453:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 112 00000100:00100000:2.0:1788652188.471462:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2345:x1875537603592320:12345-192.168.203.50@tcp:250: 00010000:00080000:2.0:1788652188.471492:0:5828:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 7caf30d4-39a4-43d7-8f50-ddf5519bc0fc@192.168.203.50@tcp t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:2.0:1788652188.471519:0:5828:0:(genops.c:1385:class_connect()) connect: client 7caf30d4-39a4-43d7-8f50-ddf5519bc0fc, cookie 0x340ed74ef02a7504 00000100:00080000:2.0:1788652188.471672:0:5828:0:(import.c:65:import_set_state_nolock()) ffff8cbe81ecc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788652188.471760:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+5:2345:x1875537603592320:12345-192.168.203.50@tcp:250: Request processed in 297us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652188.471768:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 112 00000100:00100000:0.0:1788652188.480597:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652188.480642:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603592448 00000100:00100000:0.0:1788652188.480652:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603592448 00000100:00100000:0.0:1788652188.480698:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 113 00000100:00100000:0.0:1788652188.480707:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+5:5574:x1875537603592448:12345-192.168.203.50@tcp:101: 00010000:00010000:0.0:1788652188.480724:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652188.480742:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe49e56800/0x340ed74ef02a750b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0732 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652188.480791:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe49e56800/0x340ed74ef02a750b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0732 expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652188.480802:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe49e56800/0x340ed74ef02a750b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0732 expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652188.480812:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e56800, rc 0) 00000100:00100000:0.0:1788652188.480868:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+6:5574:x1875537603592448:12345-192.168.203.50@tcp:101: Request processed in 162us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652188.480884:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 113 00000100:00100000:1.0:1788652188.484919:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652188.486550:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603592576 00000100:00100000:3.0:1788652188.486565:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603592576 00000100:00100000:3.0:1788652188.486641:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 114 00000100:00100000:3.0:1788652188.486652:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+6:5574:x1875537603592576:12345-192.168.203.50@tcp:501: 00000100:00100000:3.0:1788652188.486987:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+6:5574:x1875537603592576:12345-192.168.203.50@tcp:501: Request processed in 336us (2078us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788652188.486995:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 114 00000100:00100000:2.0:1788652188.503273:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652188.503895:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603592704 00000100:00100000:3.0:1788652188.503911:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603592704 00000100:00100000:3.0:1788652188.503974:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 115 00000100:00100000:3.0:1788652188.503985:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+6:5574:x1875537603592704:12345-192.168.203.50@tcp:101: 00010000:00010000:3.0:1788652188.504016:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652188.504037:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7a0e5a00/0x340ed74ef02a7512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0739 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652188.504078:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7a0e5a00/0x340ed74ef02a7512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0739 expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652188.504092:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7a0e5a00/0x340ed74ef02a7512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0739 expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652188.504102:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5a00, rc 0) 00000100:00100000:3.0:1788652188.504173:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+7:5574:x1875537603592704:12345-192.168.203.50@tcp:101: Request processed in 190us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652188.504179:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 115 00000100:00100000:0.0:1788652188.508477:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652188.508816:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603592832 00000100:00100000:1.0:1788652188.508826:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603592832 00000100:00100000:1.0:1788652188.508888:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 116 00000100:00100000:1.0:1788652188.508898:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+7:5574:x1875537603592832:12345-192.168.203.50@tcp:501: 00000100:00100000:1.0:1788652188.509192:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+8:5574:x1875537603592832:12345-192.168.203.50@tcp:501: Request processed in 294us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652188.509201:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 116 00000100:00100000:2.0:1788652188.515685:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652188.515756:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603592960 00000100:00100000:3.0:1788652188.515766:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603592960 00000100:00100000:3.0:1788652188.515841:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 117 00000100:00100000:3.0:1788652188.515851:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+8:5574:x1875537603592960:12345-192.168.203.50@tcp:503: 00000100:00100000:3.0:1788652188.516188:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+8:5574:x1875537603592960:12345-192.168.203.50@tcp:503: Request processed in 337us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652188.516196:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 117 00000100:00100000:0.0:1788652188.523171:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652188.523206:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603593088 00000100:00100000:0.0:1788652188.523215:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603593088 00000100:00100000:0.0:1788652188.523262:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 118 00000100:00100000:0.0:1788652188.523271:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+8:5593:x1875537603593088:12345-192.168.203.50@tcp:502: 00000100:00100000:0.0:1788652188.523581:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+8:5593:x1875537603593088:12345-192.168.203.50@tcp:502: Request processed in 310us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652188.523589:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 118 00000100:00100000:0.0:1788652188.551667:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652188.551795:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603593216 00000100:00100000:1.0:1788652188.551806:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603593216 00000100:00100000:1.0:1788652188.551873:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 119 00000100:00100000:1.0:1788652188.551883:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+8:5593:x1875537603593216:12345-192.168.203.50@tcp:502: 00000100:00100000:1.0:1788652188.552155:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+8:5593:x1875537603593216:12345-192.168.203.50@tcp:502: Request processed in 272us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652188.552162:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 119 00000100:00100000:0.0:1788652188.559559:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652188.559848:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603593344 00000100:00100000:3.0:1788652188.559863:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603593344 00000100:00100000:3.0:1788652188.559920:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 120 00000100:00100000:3.0:1788652188.559930:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+8:5574:x1875537603593344:12345-192.168.203.50@tcp:101: 00010000:00010000:3.0:1788652188.559947:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652188.559965:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7a0e5e00/0x340ed74ef02a7519 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0763 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652188.560012:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7a0e5e00/0x340ed74ef02a7519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0763 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652188.560024:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7a0e5e00/0x340ed74ef02a7519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0763 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652188.560034:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5e00, rc 0) 00000100:00100000:3.0:1788652188.560102:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+9:5574:x1875537603593344:12345-192.168.203.50@tcp:101: Request processed in 173us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652188.560109:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 120 00000100:00100000:1.0:1788652188.563643:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652188.563801:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603593472 00000100:00100000:0.0:1788652188.563812:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603593472 00000100:00100000:0.0:1788652188.563866:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 121 00000100:00100000:0.0:1788652188.563876:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+9:5574:x1875537603593472:12345-192.168.203.50@tcp:256: 20000000:01000000:0.0:1788652188.563899:0:5828:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788652188.563926:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788652188.563930:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788652188.563933:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788652188.563935:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788652188.565811:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+9:5574:x1875537603593472:12345-192.168.203.50@tcp:256: Request processed in 1925us (2168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652188.565825:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 121 00000100:00100000:0.0:1788652188.572425:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652188.572498:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603593600 00000100:00100000:2.0:1788652188.572508:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603593600 00000100:00100000:2.0:1788652188.572561:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 122 00000100:00100000:2.0:1788652188.572571:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+9:5574:x1875537603593600:12345-192.168.203.50@tcp:101: 00010000:00010000:2.0:1788652188.572589:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652188.572714:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe8215e200/0x340ed74ef02a7520 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f076a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652188.572757:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe8215e200/0x340ed74ef02a7520 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f076a expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652188.572800:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe8215e200/0x340ed74ef02a7520 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f076a expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652188.572812:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215e200, rc 0) 00000100:00100000:2.0:1788652188.572872:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:5574:x1875537603593600:12345-192.168.203.50@tcp:101: Request processed in 302us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652188.572899:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 122 00000100:00100000:3.0:1788652188.574906:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652188.575242:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603593728 00000100:00100000:0.0:1788652188.575251:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603593728 00000100:00100000:0.0:1788652188.575315:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 123 00000100:00100000:0.0:1788652188.575325:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:5574:x1875537603593728:12345-192.168.203.50@tcp:501: 00000100:00100000:0.0:1788652188.575604:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:5574:x1875537603593728:12345-192.168.203.50@tcp:501: Request processed in 279us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652188.576199:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 123 00000100:00100000:0.0:1788652188.577712:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652188.577803:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603593856 00000100:00100000:2.0:1788652188.577811:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603593856 00000100:00100000:2.0:1788652188.577864:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 124 00000100:00100000:2.0:1788652188.577873:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:5574:x1875537603593856:12345-192.168.203.50@tcp:503: 00000100:00100000:2.0:1788652188.578515:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:5574:x1875537603593856:12345-192.168.203.50@tcp:503: Request processed in 639us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652188.578524:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 124 00000100:00100000:3.0:1788652188.588149:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652188.588201:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603593984 00000100:00100000:1.0:1788652188.588212:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603593984 00000100:00100000:1.0:1788652188.588270:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 125 00000100:00100000:1.0:1788652188.588331:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:5594:x1875537603593984:12345-192.168.203.50@tcp:502: 00000100:00100000:1.0:1788652188.588655:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:5594:x1875537603593984:12345-192.168.203.50@tcp:502: Request processed in 374us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652188.588664:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 125 00000100:00100000:3.0:1788652188.592529:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652188.592755:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603594112 00000100:00100000:2.0:1788652188.592766:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603594112 00000100:00100000:2.0:1788652188.592841:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 126 00000100:00100000:2.0:1788652188.592851:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:5594:x1875537603594112:12345-192.168.203.50@tcp:502: 00000100:00100000:2.0:1788652188.593128:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:5594:x1875537603594112:12345-192.168.203.50@tcp:502: Request processed in 276us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652188.593137:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 126 00000100:00100000:3.0:1788652188.596975:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652188.597048:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603594240 00000100:00100000:0.0:1788652188.597059:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603594240 00000100:00100000:0.0:1788652188.597110:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:0.0:1788652188.597119:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2345:x1875537603594240:12345-192.168.203.50@tcp:38: 00010000:00080000:0.0:1788652188.597150:0:6701:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:0.0:1788652188.597199:0:6701:0:(genops.c:1385:class_connect()) connect: client 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c, cookie 0x340ed74ef02a7527 00000004:00100000:0.0:1788652188.597228:0:6701:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788652188.597233:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788652188.635816:0:6701:0:(import.c:65:import_set_state_nolock()) ffff8cbe747a9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788652188.635916:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2345:x1875537603594240:12345-192.168.203.50@tcp:38: Request processed in 38795us (38953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652188.635928:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 4 00010000:00010000:1.0:1788652188.936082:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652189.320080:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627733888:0@lo:400: 00000100:00100000:2.0:1788652189.320150:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652189.320216:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788652189.320222:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875537627733760:0@lo:400: 00000100:00100000:2.0:1788652189.320246:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652189.320282:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627733760 00000100:00100000:2.0:1788652189.320289:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627733760 00000100:00100000:3.0:1788652189.320451:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a406680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875537627733632:0@lo:400: 00000100:00100000:3.0:1788652189.320495:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652189.320513:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627734144:0@lo:400: 00000100:00100000:3.0:1788652189.320535:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652189.320570:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788652189.320576:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627733504:0@lo:400: 00000100:00100000:3.0:1788652189.320602:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652189.320616:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875537627734016:0@lo:400: 00000100:00100000:3.0:1788652189.320635:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652189.320661:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627733888 00000100:00100000:3.0:1788652189.320665:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627733888 00000100:00100000:3.0:1788652189.320700:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627734144 00000100:00100000:3.0:1788652189.320720:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627734144 00000100:00100000:3.0:1788652189.320742:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788652189.320751:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627733888:12345-0@lo:400: 00000100:00100000:3.0:1788652189.320827:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627733888:12345-0@lo:400: Request processed in 76us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652189.320834:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788652189.320849:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788652189.320856:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627734144:12345-0@lo:400: 00000100:00100000:3.0:1788652189.320887:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627734144:12345-0@lo:400: Request processed in 32us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652189.320893:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788652189.320910:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627733632 00000100:00100000:3.0:1788652189.320913:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627733632 00000100:00100000:3.0:1788652189.320931:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627734016 00000100:00100000:3.0:1788652189.320933:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627734016 00000100:00100000:3.0:1788652189.320946:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788652189.320952:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875537627733632:12345-0@lo:400: 00000100:00100000:3.0:1788652189.320981:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875537627733632:12345-0@lo:400: Request processed in 29us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652189.320987:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788652189.320998:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788652189.321004:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875537627734016:12345-0@lo:400: 00000100:00100000:3.0:1788652189.321029:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875537627734016:12345-0@lo:400: Request processed in 25us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652189.321034:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788652189.321074:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a405500 x1875537627734016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652189.321099:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875537627734016:0@lo:400: 00010000:00080000:3.0:1788652189.321112:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a406680 x1875537627733632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652189.321120:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a406680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875537627733632:0@lo:400: 00010000:00080000:3.0:1788652189.321129:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a407800 x1875537627734144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652189.321136:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788652189.321150:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627734144:0@lo:400: 00010000:00080000:3.0:1788652189.321204:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a406a00 x1875537627733888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652189.321213:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627733888:0@lo:400: 00000100:00100000:2.0:1788652189.325521:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788652189.325547:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875537627733760:12345-0@lo:400: 00000100:00100000:2.0:1788652189.325656:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875537627733760:12345-0@lo:400: Request processed in 123us (5408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652189.325680:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788652189.325745:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a404a80 x1875537627733760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652189.325760:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a404a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875537627733760:0@lo:400: 00000100:00080000:0.0:1788652189.326020:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788652189.326026:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788652189.326029:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788652189.326309:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627733504 00000100:00100000:1.0:1788652189.326316:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627733504 00000100:00100000:1.0:1788652189.326368:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788652189.326376:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:3306:x1875537627733504:12345-0@lo:400: 00000100:00100000:1.0:1788652189.326439:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:3306:x1875537627733504:12345-0@lo:400: Request processed in 65us (5835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652189.326446:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788652189.326748:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627733504:0@lo:400: 00000100:00100000:3.0:1788652189.654707:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652189.654749:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652189.654831:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603594496 00000100:00100000:2.0:1788652189.654841:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603594496 00000100:00100000:2.0:1788652189.654926:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603594368 00000100:00100000:2.0:1788652189.654930:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603594368 00000100:00100000:2.0:1788652189.654949:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:2.0:1788652189.654960:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:5574:x1875537603594496:12345-192.168.203.50@tcp:41: 00000004:00000024:2.0:1788652189.655003:0:5836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788652189.655082:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:5574:x1875537603594496:12345-192.168.203.50@tcp:41: Request processed in 124us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652189.655089:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:2.0:1788652189.655116:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:2.0:1788652189.655123:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:0:x1875537603594368:12345-192.168.203.50@tcp:41: 00000100:00080000:3.0:1788652189.655273:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1788652189.655611:0:5836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788652189.655696:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:0:x1875537603594368:12345-192.168.203.50@tcp:41: Request processed in 573us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652189.655703:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:3.0:1788652189.666673:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652189.672085:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603594624 00000100:00100000:0.0:1788652189.672113:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603594624 00000100:00100000:0.0:1788652189.672202:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:0.0:1788652189.672213:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:5574:x1875537603594624:12345-192.168.203.50@tcp:40: 00000100:00100000:0.0:1788652189.672337:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:5574:x1875537603594624:12345-192.168.203.50@tcp:40: Request processed in 119us (5671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652189.672345:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:3.0:1788652189.677681:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652189.677727:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652189.677759:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652189.677830:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652189.677836:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603595008 00000100:00100000:2.0:1788652189.677847:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603595008 00000100:00100000:3.0:1788652189.677862:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603595136 00000100:00100000:3.0:1788652189.677866:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603595136 00000100:00100000:3.0:1788652189.677905:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 128 00000100:00100000:3.0:1788652189.677916:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:2349:x1875537603595136:12345-192.168.203.50@tcp:400: 00000100:00100000:2.0:1788652189.677995:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:3.0:1788652189.677999:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:2349:x1875537603595136:12345-192.168.203.50@tcp:400: Request processed in 86us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652189.678002:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:5574:x1875537603595008:12345-192.168.203.50@tcp:33: 00000100:00100000:3.0:1788652189.678007:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 128 00000100:00100000:1.0:1788652189.678313:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603594752 00000100:00100000:1.0:1788652189.678319:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603594752 00000100:00100000:1.0:1788652189.678345:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603594880 00000100:00100000:1.0:1788652189.678348:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603594880 00000100:00100000:1.0:1788652189.678360:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:1.0:1788652189.678365:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1875537603594752:12345-192.168.203.50@tcp:8: 00010000:00080000:1.0:1788652189.678388:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:1.0:1788652189.678416:0:6680:0:(genops.c:1385:class_connect()) connect: client 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c, cookie 0x340ed74ef02a752e 00002000:00100000:1.0:1788652189.678427:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c/ffff8cbe512cf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788652189.678452:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788652189.678802:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788652189.678836:0:6680:0:(import.c:65:import_set_state_nolock()) ffff8cbe512cb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788652189.678899:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2345:x1875537603594752:12345-192.168.203.50@tcp:8: Request processed in 532us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652189.678906:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:1.0:1788652189.678923:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:1.0:1788652189.678928:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1875537603594880:12345-192.168.203.50@tcp:8: 00010000:00080000:1.0:1788652189.678944:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:1.0:1788652189.678961:0:6680:0:(genops.c:1385:class_connect()) connect: client 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c, cookie 0x340ed74ef02a7535 00002000:00100000:1.0:1788652189.678975:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c/ffff8cbe512c9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788652189.678990:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788652189.679223:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788652189.679239:0:6680:0:(import.c:65:import_set_state_nolock()) ffff8cbe512ca000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788652189.679281:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2345:x1875537603594880:12345-192.168.203.50@tcp:8: Request processed in 350us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652189.679287:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 9 00000004:00080000:3.0:1788652189.703072:0:5838:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 25011us 00000004:00200000:3.0:1788652189.736534:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788652189.736661:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:5574:x1875537603595008:12345-192.168.203.50@tcp:33: Request processed in 58652us (58894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652189.736686:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:2.0:1788652189.832588:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788652189.832632:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627734272:0@lo:13: 00000100:00100000:2.0:1788652189.832705:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652189.832993:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627734272 00000100:00100000:3.0:1788652189.833002:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627734272 00000100:00100000:3.0:1788652189.833056:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788652189.833065:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627734272:12345-0@lo:13: 00002000:00000024:3.0:1788652189.833086:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652189.833138:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627734272:12345-0@lo:13: Request processed in 74us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652189.833146:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788652189.833589:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbd422caa00 x1875537627734272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652189.833609:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627734272:0@lo:13: 00000100:00100000:0.0:1788652189.933723:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652189.933807:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603595264 00000100:00100000:2.0:1788652189.933817:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603595264 00000100:00100000:2.0:1788652189.933880:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:2.0:1788652189.933892:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:5611:x1875537603595264:12345-192.168.203.50@tcp:101: 00010000:00010000:2.0:1788652189.933914:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652189.933983:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f800/0x340ed74ef02a753c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0794 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652189.934059:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7543 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652189.934077:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7543 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652189.934094:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7543 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652189.934134:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788652189.934139:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788652189.934157:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7543 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652189.934187:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f800/0x340ed74ef02a753c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0794 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652189.934228:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7543 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0794 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652189.934238:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe485ac000) 00010000:00010000:2.0:1788652189.934241:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788652189.934245:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215fc00, rc 0) 00000100:00100000:2.0:1788652189.934741:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:5611:x1875537603595264:12345-192.168.203.50@tcp:101: Request processed in 849us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652189.934750:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 8 00010000:00010000:3.0:1788652189.961633:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652190.856974:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788652190.857001:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627734400:0@lo:13: 00000100:00100000:1.0:1788652190.857070:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652190.868807:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627734400 00000100:00100000:3.0:1788652190.868823:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627734400 00000100:00100000:3.0:1788652190.868886:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788652190.868897:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627734400:12345-0@lo:13: 00002000:00000024:3.0:1788652190.868924:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652190.868990:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627734400:12345-0@lo:13: Request processed in 95us (11919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652190.868996:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788652190.869042:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a407b80 x1875537627734400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652190.869078:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627734400:0@lo:13: 00000001:00100000:2.0:1788652190.928459:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c 00010000:00010000:1.0:1788652190.989375:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652192.009217:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652192.037392:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652192.038735:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603595392 00000100:00100000:3.0:1788652192.038750:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603595392 00000100:00080000:0.0:1788652192.038929:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652192.039077:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:3.0:1788652192.039089:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:5663:x1875537603595392:12345-192.168.203.50@tcp:41: 00000004:00000024:3.0:1788652192.039134:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788652192.039214:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:5663:x1875537603595392:12345-192.168.203.50@tcp:41: Request processed in 128us (1835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652192.039221:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:3.0:1788652192.051753:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652192.059794:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603595520 00000100:00100000:0.0:1788652192.059813:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603595520 00000100:00100000:0.0:1788652192.059935:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:0.0:1788652192.059947:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:5663:x1875537603595520:12345-192.168.203.50@tcp:13: 00002000:00000024:0.0:1788652192.059998:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788652192.060075:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:5663:x1875537603595520:12345-192.168.203.50@tcp:13: Request processed in 130us (8335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652192.060083:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00080000:3.0:1788652192.061003:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788652192.066983:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652192.067060:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603595648 00000100:00100000:0.0:1788652192.067071:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603595648 00000100:00100000:0.0:1788652192.067140:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:0.0:1788652192.067150:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:5663:x1875537603595648:12345-192.168.203.50@tcp:13: 00002000:00000024:0.0:1788652192.067187:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788652192.067257:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:5663:x1875537603595648:12345-192.168.203.50@tcp:13: Request processed in 109us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652192.067265:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00080000:3.0:1788652192.068820:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788652193.035128:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788652193.981339:0:5857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c 00000001:00100000:0.0:1788652193.995248:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c 00010000:00010000:3.0:1788652194.057558:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652194.446409:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627734528:0@lo:400: 00000100:00100000:0.0:1788652194.446510:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652194.446569:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627735040:0@lo:400: 00000100:00100000:0.0:1788652194.446597:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652194.446628:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788652194.446632:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875537627734656:0@lo:400: 00000100:00100000:0.0:1788652194.446714:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652194.446735:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627735168:0@lo:400: 00000100:00100000:0.0:1788652194.446763:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652194.446818:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627734784:0@lo:400: 00000100:00100000:0.0:1788652194.446844:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652194.446865:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788652194.446870:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627734912:0@lo:400: 00000100:00100000:0.0:1788652194.446892:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652194.446924:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627734528 00000100:00100000:0.0:1788652194.446933:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627734528 00000100:00100000:0.0:1788652194.446988:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788652194.446999:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+19:3305:x1875537627734528:12345-0@lo:400: 00000100:00100000:0.0:1788652194.447055:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+19:3305:x1875537627734528:12345-0@lo:400: Request processed in 57us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652194.447063:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788652194.447100:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627735040 00000100:00100000:0.0:1788652194.447104:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627735040 00000100:00100000:0.0:1788652194.447141:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627734656 00000100:00100000:0.0:1788652194.447144:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627734656 00000100:00100000:0.0:1788652194.447155:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627734784 00000100:00100000:0.0:1788652194.447158:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627734784 00000100:00100000:0.0:1788652194.447172:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788652194.447179:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627735040:12345-0@lo:400: 00000100:00100000:0.0:1788652194.447214:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627735040:12345-0@lo:400: Request processed in 36us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652194.447221:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788652194.447232:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788652194.447238:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875537627734656:12345-0@lo:400: 00000100:00100000:0.0:1788652194.447289:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875537627734656:12345-0@lo:400: Request processed in 51us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652194.447296:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788652194.447307:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788652194.447312:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627734784:12345-0@lo:400: 00000100:00100000:0.0:1788652194.447341:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627734784:12345-0@lo:400: Request processed in 30us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652194.447347:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788652194.447367:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627735168 00000100:00100000:0.0:1788652194.447371:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627735168 00000100:00100000:0.0:1788652194.447402:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627734912 00000100:00100000:0.0:1788652194.447406:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627734912 00000100:00100000:0.0:1788652194.447422:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788652194.447428:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627735168:12345-0@lo:400: 00000100:00100000:0.0:1788652194.447459:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627735168:12345-0@lo:400: Request processed in 32us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652194.447465:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788652194.447475:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788652194.447480:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627734912:12345-0@lo:400: 00000100:00100000:0.0:1788652194.447505:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627734912:12345-0@lo:400: Request processed in 25us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652194.447510:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788652194.447538:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788652194.447543:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788652194.447546:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788652194.447587:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe819e7480 x1875537627734912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652194.447617:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627734912:0@lo:400: 00000100:00100000:0.0:1788652194.447634:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627734784:0@lo:400: 00000100:00100000:0.0:1788652194.447672:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875537627734656:0@lo:400: 00010000:00080000:0.0:1788652194.447684:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe819e6d80 x1875537627735168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652194.447692:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627735168:0@lo:400: 00000100:00100000:0.0:1788652194.447700:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627734528:0@lo:400: 00000100:00100000:0.0:1788652194.447710:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627735040:0@lo:400: 00000001:02000400:0.0:1788652194.753756:0:8285:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788652194.954416:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627735296:0@lo:13: 00000100:00100000:0.0:1788652194.955222:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652194.955361:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627735296 00000100:00100000:1.0:1788652194.955372:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627735296 00000100:00100000:1.0:1788652194.955440:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788652194.955452:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627735296:12345-0@lo:13: 00002000:00000024:1.0:1788652194.955498:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788652194.955575:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627735296:12345-0@lo:13: Request processed in 125us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652194.955582:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788652194.955703:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbd422c9c00 x1875537627735296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652194.955726:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627735296:0@lo:13: 00000100:00100000:2.0:1788652194.997860:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652194.997906:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652194.997947:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652194.997974:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652194.998012:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603596032 00000100:00100000:1.0:1788652194.998023:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603595904 00000100:00100000:2.0:1788652194.998033:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603596032 00000100:00100000:1.0:1788652194.998040:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603595904 00000100:00100000:3.0:1788652194.998103:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603596160 00000100:00100000:3.0:1788652194.998108:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603596160 00000100:00100000:0.0:1788652194.998122:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603595776 00000100:00100000:0.0:1788652194.998128:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603595776 00000100:00100000:0.0:1788652194.998187:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 130 00000100:00100000:2.0:1788652194.998189:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:0.0:1788652194.998204:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:2346:x1875537603595776:12345-192.168.203.50@tcp:400: 00000100:00100000:2.0:1788652194.998205:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a407b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2346:x1875537603596032:12345-192.168.203.50@tcp:400: 00000100:00100000:0.0:1788652194.998315:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:2346:x1875537603595776:12345-192.168.203.50@tcp:400: Request processed in 117us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652194.998323:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 130 00000100:00100000:1.0:1788652194.998683:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 25 00000100:00100000:1.0:1788652194.998692:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2346:x1875537603595904:12345-192.168.203.50@tcp:400: 00000100:00100000:3.0:1788652195.000638:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788652195.000655:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788652195.001071:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:3.0:1788652195.001281:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a406a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2346:x1875537603596160:12345-192.168.203.50@tcp:400: 00000100:00100000:2.0:1788652195.001443:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a407b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2346:x1875537603596032:12345-192.168.203.50@tcp:400: Request processed in 3241us (3532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652195.001451:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2346:x1875537603595904:12345-192.168.203.50@tcp:400: Request processed in 2755us (3498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652195.001463:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00080000:2.0:1788652195.001507:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788652195.001515:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788652195.001518:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788652195.001608:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a406a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2346:x1875537603596160:12345-192.168.203.50@tcp:400: Request processed in 408us (3513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652195.001618:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:1.0:1788652195.001872:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 25 00010000:00010000:3.0:1788652195.080701:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652195.976089:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788652195.976124:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627735424:0@lo:13: 00000100:00100000:3.0:1788652195.976225:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652195.976318:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627735424 00000100:00100000:3.0:1788652195.976328:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627735424 00000100:00100000:3.0:1788652195.976384:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788652195.976393:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627735424:12345-0@lo:13: 00002000:00000024:3.0:1788652195.976440:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652195.976573:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a219500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627735424:12345-0@lo:13: Request processed in 180us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652195.976581:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788652195.976704:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a21b800 x1875537627735424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652195.976725:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627735424:0@lo:13: 00010000:00010000:3.0:1788652196.104918:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652197.129716:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652198.151963:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788652198.751630:0:8433:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff53f6e650 20000000:00000080:2.0:1788652198.751652:0:8433:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cbe81ed6c00 uarg=0000000000000000 20000000:01000000:2.0:1788652198.751689:0:8433:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788652198.751692:0:8433:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788652198.751695:0:8433:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788652198.751700:0:8433:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788652198.751705:0:8433:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788652198.751718:0:8433:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788652198.751720:0:8433:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788652198.752033:0:8433:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788652198.752037:0:8433:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788652198.755578:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788652198.756308:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788652198.756374:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788652198.756423:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1788652198.756438:0:8433:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788652198.756440:0:8433:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788652198.757678:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788652198.758278:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788652198.758345:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1788652198.758457:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1788652198.758471:0:8433:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788652198.758474:0:8433:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788652198.759638:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1788652198.762574:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1788652198.762642:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1788652198.762681:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1788652198.762697:0:8433:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788652198.762699:0:8433:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788652198.764122:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1788652198.764655:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1788652198.764702:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1788652198.764746:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:2.0:1788652198.764761:0:8433:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788652198.764939:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbe8215ee00/0x340ed74ef02a754a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652198.764959:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe8215f000/0x340ed74ef02a7447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a7440 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652198.764967:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a7471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a746a expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652198.764974:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe4151a400/0x340ed74ef02a749b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a7494 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652198.764980:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe8215e400/0x340ed74ef02a74a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a74a2 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652198.764987:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe52924400/0x340ed74ef02a74b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a74b0 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652198.764993:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe49e56a00/0x340ed74ef02a74d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a74cc expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652198.764999:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe7a0e5c00/0x340ed74ef02a74fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a74f6 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652198.765009:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe49e56800/0x340ed74ef02a750b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0732 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652198.765017:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe7a0e5a00/0x340ed74ef02a7512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0739 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652198.765025:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbe8215ee00/0x340ed74ef02a754a lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652198.765074:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe7a0e5a00/0x340ed74ef02a7512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0739 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652198.765089:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe7a0e5a00/0x340ed74ef02a7512 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0739 expref: 9 pid: 5828 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652198.765104:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a407800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875537627735552:192.168.203.50@tcp:104: 00010000:00010000:2.0:1788652198.765283:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe49e56800/0x340ed74ef02a750b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0732 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652198.765293:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe49e56800/0x340ed74ef02a750b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0732 expref: 9 pid: 5830 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652198.765302:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a406680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875537627735680:192.168.203.50@tcp:104: 00010000:00010000:2.0:1788652198.765334:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe7a0e5c00/0x340ed74ef02a74fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a74f6 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652198.765342:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe7a0e5c00/0x340ed74ef02a74fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a74f6 expref: 18 pid: 5829 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652198.765352:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a405500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875537627735808:0@lo:104: 00000100:00100000:2.0:1788652198.765623:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788652198.765697:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe49e56a00/0x340ed74ef02a74d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a74cc expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652198.765705:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe49e56a00/0x340ed74ef02a74d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a74cc expref: 18 pid: 5828 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652198.765726:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875537627735936:0@lo:104: 00000100:00100000:2.0:1788652198.765751:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788652198.767009:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe52924400/0x340ed74ef02a74b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a74b0 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652198.767025:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe52924400/0x340ed74ef02a74b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a74b0 expref: 18 pid: 5829 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652198.767036:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875537627736064:0@lo:104: 00010000:00010000:2.0:1788652198.767072:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe8215e400/0x340ed74ef02a74a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a74a2 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652198.767080:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe8215e400/0x340ed74ef02a74a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a74a2 expref: 18 pid: 5830 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652198.767087:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875537627736192:0@lo:104: 00010000:00010000:2.0:1788652198.767112:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe4151a400/0x340ed74ef02a749b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a7494 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652198.767119:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe4151a400/0x340ed74ef02a749b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a7494 expref: 18 pid: 5829 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652198.767126:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875537627736320:0@lo:104: 00010000:00010000:2.0:1788652198.767144:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a7471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a746a expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652198.767151:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a7471 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a746a expref: 18 pid: 5830 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652198.767174:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875537627736448:0@lo:104: 00010000:00010000:2.0:1788652198.767196:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe8215f000/0x340ed74ef02a7447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a7440 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652198.767204:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe8215f000/0x340ed74ef02a7447 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a7440 expref: 18 pid: 5829 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652198.767211:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875537627736576:0@lo:104: 00000100:00100000:2.0:1788652198.767224:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5eb13240 going to sleep for 11 seconds 00000100:00100000:1.0:1788652198.767374:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788652198.767401:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652198.767480:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652198.767498:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627735808 00000100:00100000:3.0:1788652198.767505:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627735808 00000100:00100000:3.0:1788652198.767541:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627735936 00000100:00100000:3.0:1788652198.767543:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627735936 00000100:00100000:3.0:1788652198.767551:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627736064 00000100:00100000:3.0:1788652198.767553:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627736064 00000100:00100000:3.0:1788652198.767565:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788652198.767573:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a404e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+5:8433:x1875537627735808:12345-0@lo:104: 00010000:00010000:3.0:1788652198.767584:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe52925200/0x340ed74ef02a74f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a74fd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.767646:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788652198.767652:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a404e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+5:8433:x1875537627735808:12345-0@lo:104: Request processed in 80us (2030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652198.767668:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788652198.767684:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788652198.767689:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a49d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+4:8433:x1875537627735936:12345-0@lo:104: 00010000:00010000:3.0:1788652198.767696:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a74cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a74d3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.767737:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788652198.767741:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a49d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+4:8433:x1875537627735936:12345-0@lo:104: Request processed in 53us (1989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652198.767747:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788652198.767809:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788652198.767815:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+3:8433:x1875537627736064:12345-0@lo:104: 00010000:00010000:3.0:1788652198.767822:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a800/0x340ed74ef02a74b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a74b7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.767844:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788652198.767848:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+3:8433:x1875537627736064:12345-0@lo:104: Request processed in 34us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652198.767854:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1788652198.767868:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788652198.767873:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe52925200/0x340ed74ef02a74f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a74fd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.767880:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe52925200 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:3.0:1788652198.767885:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe52925200/0x340ed74ef02a74f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a74fd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.767903:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe52925200/0x340ed74ef02a74f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a74fd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788652198.767911:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe52925200/0x340ed74ef02a74f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a74fd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652198.767917:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788652198.767941:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe52925200/0x340ed74ef02a74f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a74fd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.767947:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788652198.767960:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe52925200/0x340ed74ef02a74f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a74fd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.767967:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe52925200/0x340ed74ef02a74f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a74fd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.767981:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788652198.767984:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a74cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a74d3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.767989:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151a600 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:3.0:1788652198.767992:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a74cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a74d3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.767998:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a74cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a74d3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788652198.768003:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a74cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a74d3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652198.768014:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788652198.768028:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a74cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a74d3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.768034:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788652198.768039:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a74cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a74d3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.768044:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a600/0x340ed74ef02a74cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a74d3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.768053:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652198.768056:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a800/0x340ed74ef02a74b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a74b7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.768061:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151a800 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:3.0:1788652198.768063:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a800/0x340ed74ef02a74b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a74b7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.768069:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a800/0x340ed74ef02a74b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a74b7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788652198.768076:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a800/0x340ed74ef02a74b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a74b7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652198.768081:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788652198.768092:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a800/0x340ed74ef02a74b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a74b7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.768096:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788652198.768117:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a800/0x340ed74ef02a74b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a74b7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.768124:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a800/0x340ed74ef02a74b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a74b7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.768133:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652198.768135:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652198.768137:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652198.768149:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627736960:0@lo:103: 00000100:00100000:3.0:1788652198.768178:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652198.768208:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627736960 00000100:00100000:3.0:1788652198.768211:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627736960 00010000:00010000:3.0:1788652198.768229:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe52924400/0x340ed74ef02a74b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a74b0 expref: 19 pid: 5829 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652198.768260:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788652198.768266:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a219880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f811a652-691e-4a40-b660-977a4758dd08+19:3303:x1875537627736960:12345-0@lo:103: 00010000:00010000:3.0:1788652198.768275:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652198.768279:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe52924400/0x340ed74ef02a74b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a74b0 expref: 19 pid: 5829 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.768288:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe52924400/0x340ed74ef02a74b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a74b0 expref: 19 pid: 5829 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.768304:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652198.768325:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a219880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f811a652-691e-4a40-b660-977a4758dd08+19:3303:x1875537627736960:12345-0@lo:103: Request processed in 60us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652198.768331:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788652198.768360:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627736960:0@lo:103: 00000100:00100000:3.0:1788652198.768932:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652198.768990:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652198.769014:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603596288 00000100:00100000:3.0:1788652198.769018:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603596288 00010000:00010000:3.0:1788652198.769038:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe7a0e5a00/0x340ed74ef02a7512 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0739 expref: 10 pid: 5828 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652198.769057:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603596416 00000100:00100000:3.0:1788652198.769060:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603596416 00010000:00010000:3.0:1788652198.769070:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe49e56800/0x340ed74ef02a750b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0732 expref: 11 pid: 5830 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652198.769083:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:3.0:1788652198.769089:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a21aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+11:2348:x1875537603596288:12345-192.168.203.50@tcp:103: 00010000:00010000:3.0:1788652198.769097:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652198.769101:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe7a0e5a00/0x340ed74ef02a7512 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0739 expref: 11 pid: 5828 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.769111:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe7a0e5a00/0x340ed74ef02a7512 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0739 expref: 11 pid: 5828 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.769124:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652198.769161:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a21aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+11:2348:x1875537603596288:12345-192.168.203.50@tcp:103: Request processed in 72us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652198.769167:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:3.0:1788652198.769179:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00100000:3.0:1788652198.769185:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:2349:x1875537603596416:12345-192.168.203.50@tcp:103: 00010000:00010000:3.0:1788652198.769191:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652198.769202:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe49e56800/0x340ed74ef02a750b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0732 expref: 10 pid: 5830 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.769211:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe49e56800/0x340ed74ef02a750b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0732 expref: 10 pid: 5830 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.769220:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652198.769248:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:2349:x1875537603596416:12345-192.168.203.50@tcp:103: Request processed in 62us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652198.769254:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 14 00010000:00010000:0.0:1788652198.769509:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652198.769524:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627736704:0@lo:103: 00000100:00100000:0.0:1788652198.769566:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652198.769606:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788652198.769612:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627736832:0@lo:103: 00000100:00100000:0.0:1788652198.769633:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652198.769664:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627736704 00000100:00100000:0.0:1788652198.769668:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627736704 00010000:00010000:0.0:1788652198.769685:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe7a0e5c00/0x340ed74ef02a74fd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a74f6 expref: 19 pid: 5829 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652198.769702:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627736832 00000100:00100000:0.0:1788652198.769705:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627736832 00010000:00010000:0.0:1788652198.769716:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe49e56a00/0x340ed74ef02a74d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a74cc expref: 20 pid: 5828 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652198.769727:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788652198.769733:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+20:3305:x1875537627736704:12345-0@lo:103: 00010000:00010000:0.0:1788652198.769740:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652198.769744:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe7a0e5c00/0x340ed74ef02a74fd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a74f6 expref: 20 pid: 5829 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.769753:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe7a0e5c00/0x340ed74ef02a74fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a74f6 expref: 20 pid: 5829 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.769764:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652198.769864:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+20:3305:x1875537627736704:12345-0@lo:103: Request processed in 130us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652198.769870:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788652198.769884:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788652198.769889:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+19:3305:x1875537627736832:12345-0@lo:103: 00010000:00010000:0.0:1788652198.769905:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652198.769909:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe49e56a00/0x340ed74ef02a74d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a74cc expref: 19 pid: 5828 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.769918:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe49e56a00/0x340ed74ef02a74d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a74cc expref: 19 pid: 5828 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.769928:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652198.769945:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+19:3305:x1875537627736832:12345-0@lo:103: Request processed in 57us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652198.769951:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788652198.769977:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627736832:0@lo:103: 00000100:00100000:0.0:1788652198.769986:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a21b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627736704:0@lo:103: 00010000:00010000:2.0:1788652198.770093:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe7a0e5a00/0x340ed74ef02a7512 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0739 expref: 9 pid: 5828 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652198.770106:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a407800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875537627735552:192.168.203.50@tcp:104: 00010000:00010000:2.0:1788652198.770115:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe49e56800/0x340ed74ef02a750b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0732 expref: 8 pid: 5830 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652198.770124:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a406680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875537627735680:192.168.203.50@tcp:104: 00010000:00010000:2.0:1788652198.770133:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe7a0e5c00/0x340ed74ef02a74fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a74f6 expref: 18 pid: 5829 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652198.770140:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a405500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875537627735808:0@lo:104: 00010000:00010000:2.0:1788652198.770148:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe49e56a00/0x340ed74ef02a74d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a74cc expref: 17 pid: 5828 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652198.770154:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875537627735936:0@lo:104: 00010000:00010000:2.0:1788652198.770163:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe52924400/0x340ed74ef02a74b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a74b0 expref: 16 pid: 5829 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652198.770179:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875537627736064:0@lo:104: 00000100:00100000:1.0:1788652198.770391:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652198.770441:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652198.770459:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627736192 00000100:00100000:3.0:1788652198.770463:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627736192 00000100:00100000:3.0:1788652198.770484:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627736320 00000100:00100000:3.0:1788652198.770487:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627736320 00000100:00100000:3.0:1788652198.770499:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788652198.770506:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+4:8433:x1875537627736192:12345-0@lo:104: 00010000:00010000:3.0:1788652198.770517:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe4151ac00/0x340ed74ef02a74a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a74a9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.770577:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788652198.770582:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+4:8433:x1875537627736192:12345-0@lo:104: Request processed in 77us (3101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652198.770588:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788652198.770601:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788652198.770607:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+3:8433:x1875537627736320:12345-0@lo:104: 00010000:00010000:3.0:1788652198.770614:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a7494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a749b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.770644:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788652198.770655:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+3:8433:x1875537627736320:12345-0@lo:104: Request processed in 49us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652198.770660:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788652198.770717:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875537627736192:0@lo:104: 00000100:00100000:2.0:1788652198.770725:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875537627736320:0@lo:104: 00010000:00010000:0.0:1788652198.770766:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788652198.770886:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe4151ac00/0x340ed74ef02a74a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a74a9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.770893:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151ac00 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:0.0:1788652198.770897:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe4151ac00/0x340ed74ef02a74a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a74a9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.770905:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe4151ac00/0x340ed74ef02a74a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a74a9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788652198.770912:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe4151ac00/0x340ed74ef02a74a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a74a9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652198.770917:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788652198.770952:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe4151ac00/0x340ed74ef02a74a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a74a9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.770959:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788652198.770981:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe4151ac00/0x340ed74ef02a74a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a74a9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.770988:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe4151ac00/0x340ed74ef02a74a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a74a9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.770999:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652198.771002:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a7494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a749b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.771007:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215fa00 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:0.0:1788652198.771010:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a7494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a749b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.771016:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a7494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a749b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788652198.771023:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a7494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a749b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652198.771028:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788652198.771043:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a7494 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a749b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.771049:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788652198.771060:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a7494 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a749b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.771076:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a7494 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a749b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.771085:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652198.771087:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652198.771088:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652198.771096:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788652198.771107:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627737216:0@lo:103: 00000100:00100000:0.0:1788652198.771137:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652198.771169:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788652198.771176:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627737088:0@lo:103: 00000100:00100000:0.0:1788652198.771197:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652198.771215:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627737216 00000100:00100000:0.0:1788652198.771218:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627737216 00010000:00010000:0.0:1788652198.771246:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe4151a400/0x340ed74ef02a749b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a7494 expref: 16 pid: 5829 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652198.771264:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627737088 00000100:00100000:0.0:1788652198.771266:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627737088 00010000:00010000:0.0:1788652198.771276:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe8215e400/0x340ed74ef02a74a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a74a2 expref: 17 pid: 5830 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652198.771288:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788652198.771293:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f811a652-691e-4a40-b660-977a4758dd08+17:3306:x1875537627737216:12345-0@lo:103: 00010000:00010000:0.0:1788652198.771301:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652198.771305:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe4151a400/0x340ed74ef02a749b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a7494 expref: 17 pid: 5829 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.771325:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe4151a400/0x340ed74ef02a749b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a7494 expref: 17 pid: 5829 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.771337:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe4151a400/0x340ed74ef02a749b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a7494 expref: 17 pid: 5829 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.771348:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652198.771371:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f811a652-691e-4a40-b660-977a4758dd08+16:3306:x1875537627737216:12345-0@lo:103: Request processed in 78us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652198.771376:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788652198.771388:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788652198.771393:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51233850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f811a652-691e-4a40-b660-977a4758dd08+15:3303:x1875537627737088:12345-0@lo:103: 00010000:00010000:0.0:1788652198.771400:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652198.771403:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe8215e400/0x340ed74ef02a74a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a74a2 expref: 15 pid: 5830 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.771412:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe8215e400/0x340ed74ef02a74a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a74a2 expref: 15 pid: 5830 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.771421:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe8215e400/0x340ed74ef02a74a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a74a2 expref: 15 pid: 5830 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.771430:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652198.771447:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51233850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f811a652-691e-4a40-b660-977a4758dd08+14:3303:x1875537627737088:12345-0@lo:103: Request processed in 54us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652198.771452:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788652198.771502:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627737216:0@lo:103: 00000100:00100000:0.0:1788652198.771525:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627737088:0@lo:103: 00010000:00010000:0.0:1788652198.771554:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652198.771673:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652198.771682:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627736448 00000100:00100000:1.0:1788652198.771685:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627736448 00000100:00100000:1.0:1788652198.771703:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627736576 00000100:00100000:1.0:1788652198.771706:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627736576 00000100:00100000:1.0:1788652198.771718:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788652198.771724:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f811a652-691e-4a40-b660-977a4758dd08+4:8433:x1875537627736448:12345-0@lo:104: 00010000:00010000:1.0:1788652198.771733:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e000/0x340ed74ef02a746a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a7471 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652198.771932:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875537627736448:0@lo:104: 00010000:00010000:1.0:1788652198.771978:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788652198.771984:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f811a652-691e-4a40-b660-977a4758dd08+4:8433:x1875537627736448:12345-0@lo:104: Request processed in 261us (1542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652198.771990:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788652198.772003:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788652198.772009:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f811a652-691e-4a40-b660-977a4758dd08+3:8433:x1875537627736576:12345-0@lo:104: 00010000:00010000:1.0:1788652198.772017:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe52925c00/0x340ed74ef02a7440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a7447 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652198.772060:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788652198.772071:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f811a652-691e-4a40-b660-977a4758dd08+3:8433:x1875537627736576:12345-0@lo:104: Request processed in 62us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652198.772077:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788652198.772466:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788652198.772472:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e000/0x340ed74ef02a746a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a7471 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.772479:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e000 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:0.0:1788652198.772483:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e000/0x340ed74ef02a746a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a7471 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.772491:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e000/0x340ed74ef02a746a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a7471 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788652198.772498:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e000/0x340ed74ef02a746a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a7471 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652198.772503:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788652198.772525:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e000/0x340ed74ef02a746a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7471 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.772532:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788652198.772546:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e000/0x340ed74ef02a746a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7471 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.772553:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e000/0x340ed74ef02a746a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7471 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.772564:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652198.772567:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe52925c00/0x340ed74ef02a7440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a7447 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.772583:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe52925c00 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:0.0:1788652198.772586:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe52925c00/0x340ed74ef02a7440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a7447 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.772593:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe52925c00/0x340ed74ef02a7440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a7447 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788652198.772599:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe52925c00/0x340ed74ef02a7440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a7447 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652198.772603:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788652198.772616:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe52925c00/0x340ed74ef02a7440 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7447 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.772621:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788652198.772634:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe52925c00/0x340ed74ef02a7440 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7447 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.772640:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe52925c00/0x340ed74ef02a7440 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7447 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.772653:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652198.772655:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652198.772657:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652198.772663:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788652198.772673:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627737472:0@lo:103: 00000100:00100000:0.0:1788652198.772703:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652198.772737:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627737344:0@lo:103: 00000100:00100000:0.0:1788652198.772767:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652198.772837:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627737472 00000100:00100000:0.0:1788652198.772841:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627737472 00010000:00010000:0.0:1788652198.772861:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe8215f000/0x340ed74ef02a7447 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a7440 expref: 14 pid: 5829 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652198.772879:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627737344 00000100:00100000:0.0:1788652198.772882:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627737344 00010000:00010000:0.0:1788652198.772894:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a7471 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a746a expref: 15 pid: 5830 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652198.772906:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788652198.772911:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+15:3304:x1875537627737472:12345-0@lo:103: 00010000:00010000:0.0:1788652198.772919:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652198.772923:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe8215f000/0x340ed74ef02a7447 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a7440 expref: 15 pid: 5829 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.772932:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe8215f000/0x340ed74ef02a7447 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a7440 expref: 15 pid: 5829 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.772946:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652198.772974:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+15:3304:x1875537627737472:12345-0@lo:103: Request processed in 62us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652198.772980:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788652198.773005:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788652198.773011:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+14:3306:x1875537627737344:12345-0@lo:103: 00010000:00010000:0.0:1788652198.773018:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652198.773022:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a7471 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a746a expref: 14 pid: 5830 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.773042:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a7471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a746a expref: 14 pid: 5830 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.773052:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a7471 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a746a expref: 14 pid: 5830 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.773062:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbe8215ee00/0x340ed74ef02a754a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.773070:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe8215ee00/0x340ed74ef02a754a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.773083:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe8215ee00/0x340ed74ef02a754a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.773091:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe8215ee00/0x340ed74ef02a754a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.773098:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbe8215ee00/0x340ed74ef02a754a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.773104:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbe8215ee00/0x340ed74ef02a754a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.773109:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215ee00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:0.0:1788652198.773114:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbe8215ee00/0x340ed74ef02a754a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.773121:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbe8215ee00/0x340ed74ef02a754a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.773138:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbe8215ee00/0x340ed74ef02a754a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652198.773148:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652198.773170:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+13:3306:x1875537627737344:12345-0@lo:103: Request processed in 160us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652198.773176:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788652198.773200:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627737472:0@lo:103: 00000100:00100000:0.0:1788652198.773217:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627737344:0@lo:103: 00010000:00010000:1.0:1788652198.773402:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652198.774252:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe8215f000/0x340ed74ef02a7447 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a7440 expref: 12 pid: 5829 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652198.774268:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875537627736576:0@lo:104: 00010000:00010000:3.0:1788652198.774305:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbe8215ee00/0x340ed74ef02a754a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.774314:0:8433:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbe8215ee00/0x340ed74ef02a754a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.774320:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbe8215ee00/0x340ed74ef02a754a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652198.774326:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe8215ee00/0x340ed74ef02a754a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652199.176086:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652199.560961:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627737984:0@lo:400: 00000100:00100000:0.0:1788652199.561021:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627737600:0@lo:400: 00000100:00100000:1.0:1788652199.561030:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652199.561067:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652199.561156:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875537627737856:0@lo:400: 00000100:00100000:3.0:1788652199.561180:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875537627737728:0@lo:400: 00000100:00100000:1.0:1788652199.561188:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652199.561241:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627737984 00000100:00100000:2.0:1788652199.561249:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627737984 00000100:00100000:2.0:1788652199.561376:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788652199.561387:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627737984:12345-0@lo:400: 00000100:00100000:1.0:1788652199.561604:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627737856 00000100:00100000:1.0:1788652199.561608:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627737856 00000100:00100000:1.0:1788652199.561653:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788652199.561660:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875537627737856:12345-0@lo:400: 00000100:00100000:1.0:1788652199.561698:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875537627737856:12345-0@lo:400: Request processed in 39us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652199.561705:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788652199.561758:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875537627737856:0@lo:400: 00000100:00100000:1.0:1788652199.561823:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627737600 00000100:00100000:1.0:1788652199.561827:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627737600 00000100:00100000:1.0:1788652199.561853:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788652199.561859:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:3304:x1875537627737600:12345-0@lo:400: 00000100:00100000:1.0:1788652199.561891:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+12:3304:x1875537627737600:12345-0@lo:400: Request processed in 32us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652199.561898:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:1.0:1788652199.561939:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788652199.561943:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788652199.567263:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627737600:0@lo:400: 00000100:00100000:0.0:1788652199.567281:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875537627738112:0@lo:400: 00000100:00100000:2.0:1788652199.567912:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627737984:12345-0@lo:400: Request processed in 6522us (6878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652199.567924:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788652199.568126:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652199.568211:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652199.568252:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627738240:0@lo:400: 00000100:00100000:3.0:1788652199.568280:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652199.568316:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627738240 00000100:00100000:3.0:1788652199.568321:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627738240 00000100:00100000:3.0:1788652199.568365:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788652199.568373:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a218a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627738240:12345-0@lo:400: 00000100:00100000:3.0:1788652199.568421:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a218a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627738240:12345-0@lo:400: Request processed in 49us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652199.568446:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788652199.568463:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788652199.568488:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe759a9880 x1875537627738240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652199.568501:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627738240:0@lo:400: 00010000:00080000:1.0:1788652199.568586:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe759a9180 x1875537627737984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652199.568611:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627737984:0@lo:400: 00000100:00100000:2.0:1788652199.568704:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627738112 00000100:00100000:2.0:1788652199.568710:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627738112 00000100:00100000:0.0:1788652199.568797:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627737728 00000100:00100000:0.0:1788652199.568802:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627737728 00000100:00080000:3.0:1788652199.568921:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788652199.568940:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788652199.568950:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875537627737728:12345-0@lo:400: 00000100:00100000:0.0:1788652199.568999:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875537627737728:12345-0@lo:400: Request processed in 52us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652199.569005:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788652199.569070:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875537627737728:0@lo:400: 00000100:00100000:2.0:1788652199.569887:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788652199.569906:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875537627738112:12345-0@lo:400: 00000100:00100000:2.0:1788652199.569960:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875537627738112:12345-0@lo:400: Request processed in 59us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652199.569967:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788652199.572323:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875537627738112:0@lo:400: 10000000:01000000:2.0:1788652200.007914:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788652200.007924:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbe7fdf4800 from 39 10000000:01000000:2.0:1788652200.007930:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788652200.007984:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a7551 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652200.007996:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a7551 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652200.008016:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a7551 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652200.008058:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627738368:0@lo:101: 00000100:00100000:2.0:1788652200.008125:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652200.008192:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5eb13780 going to sleep for 11 seconds 00000100:00100000:0.0:1788652200.008398:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627738368 00000100:00100000:0.0:1788652200.008412:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627738368 00000100:00100000:0.0:1788652200.008471:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788652200.008481:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+12:5832:x1875537627738368:12345-0@lo:101: 00010000:00010000:0.0:1788652200.008494:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652200.008506:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe49e57600/0x340ed74ef02a7558 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a7551 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652200.008527:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe49e57600/0x340ed74ef02a7558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a7551 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652200.008538:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe49e57600/0x340ed74ef02a7558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a7551 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652200.008546:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e57600, rc 0) 00000100:00100000:0.0:1788652200.008596:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+13:5832:x1875537627738368:12345-0@lo:101: Request processed in 116us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652200.008602:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788652200.008934:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627738368:0@lo:101: 00010000:00010000:2.0:1788652200.008949:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a7551 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7558 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652200.008959:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a7551 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a7558 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652200.009011:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627738496:0@lo:501: 00000100:00100000:2.0:1788652200.009037:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652200.009067:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5eb13780 going to sleep for 11 seconds 00000100:00100000:1.0:1788652200.009116:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627738496 00000100:00100000:1.0:1788652200.009120:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627738496 00000100:00100000:1.0:1788652200.009151:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788652200.009158:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+13:5832:x1875537627738496:12345-0@lo:501: 00000100:00100000:1.0:1788652200.009419:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+13:5832:x1875537627738496:12345-0@lo:501: Request processed in 260us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652200.009426:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788652200.014105:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627738496:0@lo:501: 00000100:00100000:2.0:1788652200.014171:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627738624:0@lo:503: 00000100:00100000:2.0:1788652200.014255:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652200.014302:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5eb13780 going to sleep for 11 seconds 00000100:00100000:0.0:1788652200.014651:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627738624 00000100:00100000:0.0:1788652200.014658:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627738624 00000100:00100000:0.0:1788652200.014727:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788652200.014737:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+13:5832:x1875537627738624:12345-0@lo:503: 00000100:00100000:0.0:1788652200.015142:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+13:5832:x1875537627738624:12345-0@lo:503: Request processed in 406us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652200.015150:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788652200.015297:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627738624:0@lo:503: 00000100:00100000:2.0:1788652200.016286:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8451:1875537627738752:0@lo:502: 00000100:00100000:2.0:1788652200.016338:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652200.016378:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5eb13240 going to sleep for 11 seconds 00000100:00100000:1.0:1788652200.016441:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627738752 00000100:00100000:1.0:1788652200.016447:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627738752 00000100:00100000:1.0:1788652200.016488:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788652200.016496:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+13:8451:x1875537627738752:12345-0@lo:502: 00000100:00100000:1.0:1788652200.016732:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+13:8451:x1875537627738752:12345-0@lo:502: Request processed in 236us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652200.016740:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788652200.016998:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8451:1875537627738752:0@lo:502: 00000100:00100000:2.0:1788652200.017045:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8451:1875537627738880:0@lo:502: 00000100:00100000:2.0:1788652200.017083:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652200.017117:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5eb13240 going to sleep for 11 seconds 00000100:00100000:3.0:1788652200.017181:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627738880 00000100:00100000:3.0:1788652200.017187:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627738880 00000100:00100000:3.0:1788652200.017230:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788652200.017238:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+13:8451:x1875537627738880:12345-0@lo:502: 00000100:00100000:3.0:1788652200.017377:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+13:8451:x1875537627738880:12345-0@lo:502: Request processed in 140us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652200.017384:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788652200.017512:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8451:1875537627738880:0@lo:502: 00000040:00080000:2.0:1788652200.017532:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788652200.017922:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788652200.017939:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788652200.017948:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a7551 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7558 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652200.017958:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a7551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7558 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652200.017968:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788652200.017970:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788652200.017973:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788652200.017998:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52924c00/0x340ed74ef02a755f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652200.018013:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe52924c00/0x340ed74ef02a755f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652200.018023:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe52924c00/0x340ed74ef02a755f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652200.018038:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627739008:0@lo:101: 00000100:00100000:1.0:1788652200.018068:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652200.018101:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe486960c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652200.018154:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627739008 00000100:00100000:3.0:1788652200.018160:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627739008 00000100:00100000:3.0:1788652200.018186:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788652200.018192:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+13:5832:x1875537627739008:12345-0@lo:101: 00010000:00010000:3.0:1788652200.018201:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652200.018212:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7a0e5800/0x340ed74ef02a7566 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a755f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652200.018243:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7a0e5800/0x340ed74ef02a7566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a755f expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652200.018253:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7a0e5800/0x340ed74ef02a7566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a755f expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652200.018272:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5800, rc 0) 00000100:00100000:3.0:1788652200.018306:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+14:5832:x1875537627739008:12345-0@lo:101: Request processed in 114us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652200.018311:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788652200.018499:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627739008:0@lo:101: 00010000:00010000:1.0:1788652200.018511:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe52924c00/0x340ed74ef02a755f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7566 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652200.018519:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe52924c00/0x340ed74ef02a755f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a7566 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652200.018559:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627739136:0@lo:501: 00000100:00100000:1.0:1788652200.018584:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652200.018604:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe486960c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652200.018657:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627739136 00000100:00100000:0.0:1788652200.018672:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627739136 00000100:00100000:0.0:1788652200.018702:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788652200.018710:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+14:5832:x1875537627739136:12345-0@lo:501: 00000100:00100000:0.0:1788652200.019180:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+14:5832:x1875537627739136:12345-0@lo:501: Request processed in 470us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652200.019194:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788652200.019360:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627739136:0@lo:501: 00000100:00100000:1.0:1788652200.019387:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627739264:0@lo:503: 00000100:00100000:1.0:1788652200.019424:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652200.019457:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe486960c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652200.019502:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627739264 00000100:00100000:2.0:1788652200.019507:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627739264 00000100:00100000:2.0:1788652200.019540:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788652200.019548:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+14:5832:x1875537627739264:12345-0@lo:503: 00000100:00100000:2.0:1788652200.019970:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+14:5832:x1875537627739264:12345-0@lo:503: Request processed in 422us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652200.019977:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788652200.022066:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627739264:0@lo:503: 00000100:00100000:3.0:1788652200.022541:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a21a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8452:1875537627739392:0@lo:502: 00000100:00100000:3.0:1788652200.022598:0:8452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652200.022641:0:8452:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4f38fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788652200.022887:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627739392 00000100:00100000:0.0:1788652200.022893:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627739392 00000100:00100000:0.0:1788652200.022935:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788652200.022944:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+14:8452:x1875537627739392:12345-0@lo:502: 00000100:00100000:0.0:1788652200.023137:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+14:8452:x1875537627739392:12345-0@lo:502: Request processed in 194us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652200.023145:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788652200.023220:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a21a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8452:1875537627739392:0@lo:502: 00000020:01000000:2.0:1788652200.023253:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788652200.023261:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652200.023264:0:8452:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788652200.023268:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788652200.023289:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8452:1875537627739520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652200.023318:0:8452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652200.023343:0:8452:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5eb13780 going to sleep for 11 seconds 00000100:00100000:1.0:1788652200.023387:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627739520 00000100:00100000:1.0:1788652200.023395:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627739520 00000100:00100000:1.0:1788652200.023425:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788652200.023431:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+14:8452:x1875537627739520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788652200.023534:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+14:8452:x1875537627739520:12345-0@lo:502:llog_process_th.0 Request processed in 103us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652200.023541:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788652200.023638:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8452:1875537627739520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788652200.023655:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652200.023658:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652200.023671:0:8452:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788652200.023675:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788652200.025098:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788652200.025128:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788652200.025139:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52924c00/0x340ed74ef02a755f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7566 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652200.025151:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe52924c00/0x340ed74ef02a755f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7566 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652200.025162:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788652200.025165:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbe818bc800 from 39 10000000:01000000:1.0:1788652200.025168:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788652200.025201:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52924000/0x340ed74ef02a756d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652200.025208:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe52924000/0x340ed74ef02a756d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652200.025218:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe52924000/0x340ed74ef02a756d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652200.025246:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627739648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788652200.025291:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652200.025336:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb600 going to sleep for 11 seconds 00000100:00100000:3.0:1788652200.025408:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627739648 00000100:00100000:3.0:1788652200.025414:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627739648 00000100:00100000:3.0:1788652200.025453:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788652200.025460:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+14:5832:x1875537627739648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652200.025469:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652200.025482:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7a0e4000/0x340ed74ef02a7574 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a756d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652200.025504:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7a0e4000/0x340ed74ef02a7574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a756d expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652200.025514:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7a0e4000/0x340ed74ef02a7574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a756d expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652200.025522:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e4000, rc 0) 00000100:00100000:3.0:1788652200.025562:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+15:5832:x1875537627739648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652200.025568:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788652200.025904:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627739648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788652200.025920:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe52924000/0x340ed74ef02a756d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7574 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652200.025929:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe52924000/0x340ed74ef02a756d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a7574 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652200.025975:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627739776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788652200.025998:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652200.026024:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb600 going to sleep for 11 seconds 00000100:00100000:2.0:1788652200.026071:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627739776 00000100:00100000:2.0:1788652200.026075:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627739776 00000100:00100000:2.0:1788652200.026107:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788652200.026124:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+15:5832:x1875537627739776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788652200.026383:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+15:5832:x1875537627739776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652200.026391:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788652200.026609:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627739776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788652200.026651:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627739904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788652200.026766:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652200.028002:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb600 going to sleep for 11 seconds 00000100:00100000:0.0:1788652200.029196:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627739904 00000100:00100000:0.0:1788652200.029209:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627739904 00000100:00100000:0.0:1788652200.029288:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788652200.029298:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+15:5832:x1875537627739904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788652200.029524:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+15:5832:x1875537627739904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 227us (2757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652200.029531:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788652200.029659:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627739904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788652200.030385:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8453:1875537627740032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652200.030438:0:8453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652200.030477:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b09ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788652200.030529:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627740032 00000100:00100000:3.0:1788652200.030534:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627740032 00000100:00100000:3.0:1788652200.030581:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788652200.030589:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+15:8453:x1875537627740032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788652200.030979:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+15:8453:x1875537627740032:12345-0@lo:502:llog_process_th.0 Request processed in 390us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652200.030987:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788652200.031172:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8453:1875537627740032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652200.031216:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8453:1875537627740160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652200.031263:0:8453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652200.031284:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b09ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788652200.031331:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627740160 00000100:00100000:0.0:1788652200.031336:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627740160 00000100:00100000:0.0:1788652200.031368:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788652200.031375:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+15:8453:x1875537627740160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788652200.031520:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+15:8453:x1875537627740160:12345-0@lo:502:llog_process_th.0 Request processed in 144us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652200.031527:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788652200.031625:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8453:1875537627740160:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788652200.031656:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788652200.032058:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788652200.032081:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788652200.032091:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52924000/0x340ed74ef02a756d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7574 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652200.032103:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe52924000/0x340ed74ef02a756d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7574 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652200.032113:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788652200.032116:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788652200.032118:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788652200.032144:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52924600/0x340ed74ef02a757b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652200.032158:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe52924600/0x340ed74ef02a757b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652200.032169:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe52924600/0x340ed74ef02a757b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652200.032185:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627740288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788652200.032217:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652200.032249:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb600 going to sleep for 11 seconds 00000100:00100000:0.0:1788652200.032304:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627740288 00000100:00100000:0.0:1788652200.032309:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627740288 00000100:00100000:0.0:1788652200.032342:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788652200.032350:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+15:5832:x1875537627740288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652200.032367:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652200.032379:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe49e56c00/0x340ed74ef02a7582 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a757b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652200.032399:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe49e56c00/0x340ed74ef02a7582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a757b expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652200.032410:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe49e56c00/0x340ed74ef02a7582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a757b expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652200.032418:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e56c00, rc 0) 00000100:00100000:0.0:1788652200.032456:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+16:5832:x1875537627740288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652200.032461:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788652200.032534:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627740288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788652200.032548:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe52924600/0x340ed74ef02a757b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7582 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652200.032558:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe52924600/0x340ed74ef02a757b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a7582 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652200.032603:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627740416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788652200.032629:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652200.032805:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627740416 00000100:00100000:3.0:1788652200.032810:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627740416 00000100:00100000:3.0:1788652200.032840:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788652200.032847:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+16:5832:x1875537627740416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652200.033059:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+16:5832:x1875537627740416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 212us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652200.033065:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788652200.033175:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb600 going to sleep for 11 seconds 00000100:00100000:1.0:1788652200.033189:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627740416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788652200.033216:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627740544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788652200.033260:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652200.033281:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb600 going to sleep for 11 seconds 00000100:00100000:2.0:1788652200.033352:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627740544 00000100:00100000:2.0:1788652200.033356:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627740544 00000100:00100000:2.0:1788652200.033375:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788652200.033381:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+16:5832:x1875537627740544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788652200.033507:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+16:5832:x1875537627740544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652200.033514:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788652200.033604:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627740544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788652200.034284:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8454:1875537627740672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788652200.034324:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652200.034358:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb180 going to sleep for 11 seconds 00000100:00100000:2.0:1788652200.034403:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627740672 00000100:00100000:2.0:1788652200.034407:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627740672 00000100:00100000:2.0:1788652200.034439:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788652200.034446:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+16:8454:x1875537627740672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652200.034901:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+16:8454:x1875537627740672:12345-0@lo:502:llog_process_th.0 Request processed in 453us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652200.034910:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788652200.034987:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8454:1875537627740672:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788652200.035015:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788652200.035025:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652200.035027:0:8454:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788652200.035032:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788652200.035053:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8454:1875537627740800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788652200.035088:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652200.035122:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb180 going to sleep for 11 seconds 00000100:00100000:3.0:1788652200.035242:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627740800 00000100:00100000:3.0:1788652200.035248:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627740800 00000100:00100000:3.0:1788652200.035282:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788652200.035290:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+16:8454:x1875537627740800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788652200.035435:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+16:8454:x1875537627740800:12345-0@lo:502:llog_process_th.0 Request processed in 145us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652200.035441:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788652200.036912:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8454:1875537627740800:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788652200.036954:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652200.036963:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652200.036965:0:8454:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788652200.036969:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788652200.037516:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788652200.037539:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788652200.037549:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52924600/0x340ed74ef02a757b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7582 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652200.037560:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe52924600/0x340ed74ef02a757b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7582 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652200.037571:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788652200.037573:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbe50c46000 from 39 10000000:01000000:0.0:1788652200.037576:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788652200.037618:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57000/0x340ed74ef02a7589 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652200.037626:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57000/0x340ed74ef02a7589 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652200.037650:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57000/0x340ed74ef02a7589 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652200.037685:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627740928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788652200.037738:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652200.037910:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe47da4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788652200.038100:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627740928 00000100:00100000:2.0:1788652200.038107:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627740928 00000100:00100000:2.0:1788652200.038155:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788652200.038164:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+16:5832:x1875537627740928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788652200.038176:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652200.038190:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe8215f000/0x340ed74ef02a7590 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a7589 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652200.038214:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe8215f000/0x340ed74ef02a7590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a7589 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652200.038232:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe8215f000/0x340ed74ef02a7590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a7589 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652200.038240:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215f000, rc 0) 00000100:00100000:2.0:1788652200.038277:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627740928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652200.038283:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788652200.038411:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627740928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652200.038426:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57000/0x340ed74ef02a7589 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7590 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652200.038436:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57000/0x340ed74ef02a7589 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a7590 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652200.038491:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627741056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788652200.038515:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652200.038543:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe47da4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788652200.038591:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627741056 00000100:00100000:2.0:1788652200.038595:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627741056 00000100:00100000:2.0:1788652200.038626:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788652200.038644:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627741056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788652200.039085:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627741056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 440us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652200.039102:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788652200.039174:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627741056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788652200.039203:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627741184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788652200.039253:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652200.039281:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe47da4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788652200.039368:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627741184 00000100:00100000:1.0:1788652200.039373:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627741184 00000100:00100000:1.0:1788652200.039402:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788652200.039409:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627741184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788652200.039554:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627741184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652200.039560:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788652200.040006:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627741184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788652200.040476:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8455:1875537627741312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788652200.040518:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652200.040548:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe47da40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652200.040598:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627741312 00000100:00100000:1.0:1788652200.040602:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627741312 00000100:00100000:1.0:1788652200.040639:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788652200.040647:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+17:8455:x1875537627741312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788652200.041112:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+17:8455:x1875537627741312:12345-0@lo:502:llog_process_th.0 Request processed in 464us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652200.041125:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788652200.041212:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8455:1875537627741312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788652200.041267:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a218700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8455:1875537627741440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788652200.041300:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652200.041329:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4f38f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788652200.041373:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627741440 00000100:00100000:2.0:1788652200.041377:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627741440 00000100:00100000:2.0:1788652200.041407:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788652200.041414:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+17:8455:x1875537627741440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652200.041544:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+17:8455:x1875537627741440:12345-0@lo:502:llog_process_th.0 Request processed in 130us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652200.041551:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788652200.041613:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a218700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8455:1875537627741440:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788652200.041630:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788652200.042105:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788652200.042126:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788652200.042136:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57000/0x340ed74ef02a7589 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7590 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652200.042146:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57000/0x340ed74ef02a7589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7590 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652200.042155:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788652200.042157:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788652200.042160:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788652200.042185:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a7597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652200.042192:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a7597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652200.042201:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a7597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652200.042215:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627741568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788652200.042266:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652200.042298:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe45003cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652200.042356:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627741568 00000100:00100000:0.0:1788652200.042362:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627741568 00000100:00100000:0.0:1788652200.042387:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788652200.042394:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627741568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652200.042404:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652200.042417:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe49e56600/0x340ed74ef02a759e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a7597 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652200.042438:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe49e56600/0x340ed74ef02a759e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a7597 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652200.042448:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe49e56600/0x340ed74ef02a759e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a7597 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652200.042457:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e56600, rc 0) 00000100:00100000:0.0:1788652200.042497:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627741568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652200.042503:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788652200.042659:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627741568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788652200.042757:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a7597 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a759e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652200.042765:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a7597 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a759e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652200.045496:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a218700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627741696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652200.045565:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652200.045611:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4f38f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788652200.045677:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627741696 00000100:00100000:0.0:1788652200.045684:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627741696 00000100:00100000:0.0:1788652200.045730:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788652200.045739:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627741696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788652200.046015:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627741696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652200.046022:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788652200.046168:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a218700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627741696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788652200.046204:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627741824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788652200.046254:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652200.046271:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652200.046554:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627741824 00000100:00100000:0.0:1788652200.046558:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627741824 00000100:00100000:0.0:1788652200.046591:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788652200.046599:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627741824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788652200.046768:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627741824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652200.046898:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788652200.047604:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627741824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788652200.049439:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8456:1875537627741952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788652200.049514:0:8456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652200.049550:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb480 going to sleep for 11 seconds 00000100:00100000:0.0:1788652200.049687:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627741952 00000100:00100000:0.0:1788652200.049694:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627741952 00000100:00100000:0.0:1788652200.049741:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788652200.049751:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+18:8456:x1875537627741952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788652200.050256:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+18:8456:x1875537627741952:12345-0@lo:502:llog_process_th.0 Request processed in 505us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652200.050265:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788652200.050348:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8456:1875537627741952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788652200.050378:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788652200.050388:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652200.050390:0:8456:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788652200.050396:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788652200.050421:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8456:1875537627742080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788652200.050454:0:8456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652200.050488:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb480 going to sleep for 11 seconds 00000100:00100000:0.0:1788652200.051952:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627742080 00000100:00100000:0.0:1788652200.051963:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627742080 00000100:00100000:0.0:1788652200.052020:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788652200.052029:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+18:8456:x1875537627742080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788652200.052321:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+18:8456:x1875537627742080:12345-0@lo:502:llog_process_th.0 Request processed in 293us (1866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652200.052329:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788652200.054595:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8456:1875537627742080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788652200.055140:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652200.055148:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652200.055151:0:8456:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788652200.055155:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788652200.058084:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1788652200.058124:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788652200.058137:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a7597 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a759e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652200.058150:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a7597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a759e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652200.058162:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788652200.058165:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cbe4b174d40 from 1 10000000:01000000:3.0:1788652200.058167:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788652200.058210:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4800/0x340ed74ef02a75a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652200.058218:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4800/0x340ed74ef02a75a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652200.058241:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4800/0x340ed74ef02a75a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652200.058267:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a218380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627742208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788652200.058332:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652200.058377:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4f38fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788652200.058706:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627742208 00000100:00100000:0.0:1788652200.058714:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627742208 00000100:00100000:0.0:1788652200.058768:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788652200.058810:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627742208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652200.058824:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652200.058836:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe49e57200/0x340ed74ef02a75ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a75a5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652200.058860:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe49e57200/0x340ed74ef02a75ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a75a5 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652200.058888:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe49e57200/0x340ed74ef02a75ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a75a5 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652200.058899:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e57200, rc 0) 00000100:00100000:0.0:1788652200.058942:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:5832:x1875537627742208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652200.058949:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788652200.059203:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a218380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627742208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652200.059219:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4800/0x340ed74ef02a75a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a75ac expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652200.059254:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4800/0x340ed74ef02a75a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a75ac expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652200.059305:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a218380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627742336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652200.059331:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652200.059360:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4f38fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788652200.059678:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627742336 00000100:00100000:2.0:1788652200.059684:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627742336 00000100:00100000:2.0:1788652200.059717:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788652200.059724:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:5832:x1875537627742336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652200.060317:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:5832:x1875537627742336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 591us (982us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788652200.060326:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788652200.060528:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a218380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627742336:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788652200.060556:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788652200.060570:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4800/0x340ed74ef02a75a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a75ac expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652200.060579:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4800/0x340ed74ef02a75a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a75ac expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652200.072342:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788652200.072368:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627742464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788652200.072439:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652200.074592:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627742464 00000100:00100000:1.0:1788652200.074609:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627742464 00000100:00100000:1.0:1788652200.074696:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788652200.074715:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a21b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627742464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788652200.074752:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788652200.074866:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a21b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627742464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (2426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652200.074873:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788652200.075031:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbd422c9f80 x1875537627742464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652216 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652200.075054:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627742464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788652200.115400:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652200.115446:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652200.115488:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652200.115524:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652200.115544:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603596544 00000100:00100000:0.0:1788652200.115555:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603596544 00000100:00100000:0.0:1788652200.115601:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 164 00000100:00100000:0.0:1788652200.115610:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+8:2347:x1875537603596544:12345-192.168.203.50@tcp:400: 00000100:00100000:2.0:1788652200.115651:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603596928 00000100:00100000:2.0:1788652200.115657:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603596928 00000100:00100000:0.0:1788652200.115684:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+8:2347:x1875537603596544:12345-192.168.203.50@tcp:400: Request processed in 73us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652200.115692:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 164 00000100:00080000:3.0:1788652200.115704:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788652200.115714:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603596800 00000100:00100000:2.0:1788652200.115719:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603596800 00000100:00100000:1.0:1788652200.115792:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603596672 00000100:00100000:1.0:1788652200.115797:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603596672 00000100:00100000:1.0:1788652200.115834:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 29 00000100:00100000:1.0:1788652200.115843:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2347:x1875537603596672:12345-192.168.203.50@tcp:400: 00000100:00100000:1.0:1788652200.115879:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2347:x1875537603596672:12345-192.168.203.50@tcp:400: Request processed in 38us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652200.115885:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 29 00000100:00080000:1.0:1788652200.117135:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788652200.117143:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788652200.122526:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00100000:2.0:1788652200.123492:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a218000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2347:x1875537603596928:12345-192.168.203.50@tcp:400: 00000100:00100000:2.0:1788652200.123668:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a218000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2347:x1875537603596928:12345-192.168.203.50@tcp:400: Request processed in 1129us (8221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652200.123677:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00100000:2.0:1788652200.123715:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00100000:2.0:1788652200.123723:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2347:x1875537603596800:12345-192.168.203.50@tcp:400: 00000100:00100000:2.0:1788652200.123753:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2347:x1875537603596800:12345-192.168.203.50@tcp:400: Request processed in 32us (8230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652200.123796:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00100000:3.0:1788652200.186236:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652200.186401:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603597056 00000100:00100000:0.0:1788652200.186413:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603597056 00000100:00100000:0.0:1788652200.186475:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 165 00000100:00100000:0.0:1788652200.186486:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+8:5588:x1875537603597056:12345-192.168.203.50@tcp:101: 00010000:00010000:0.0:1788652200.186503:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652200.186522:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe49e57e00/0x340ed74ef02a75b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f079b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652200.186551:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe49e57e00/0x340ed74ef02a75b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f079b expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652200.186562:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe49e57e00/0x340ed74ef02a75b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f079b expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652200.186587:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e57e00, rc 0) 00000100:00100000:0.0:1788652200.186644:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+9:5588:x1875537603597056:12345-192.168.203.50@tcp:101: Request processed in 160us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652200.186651:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 165 00000100:00100000:1.0:1788652200.192083:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652200.194183:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603597184 00000100:00100000:0.0:1788652200.194200:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603597184 00000100:00100000:0.0:1788652200.194289:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 166 00000100:00100000:0.0:1788652200.194299:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+9:5588:x1875537603597184:12345-192.168.203.50@tcp:501: 00000100:00100000:0.0:1788652200.194935:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+9:5588:x1875537603597184:12345-192.168.203.50@tcp:501: Request processed in 634us (2859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652200.194944:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 166 00010000:00010000:1.0:1788652200.200315:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652200.201448:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652200.201543:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603597312 00000100:00100000:1.0:1788652200.201553:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603597312 00000100:00100000:1.0:1788652200.201610:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 167 00000100:00100000:1.0:1788652200.201620:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+9:5588:x1875537603597312:12345-192.168.203.50@tcp:503: 00000100:00100000:1.0:1788652200.201891:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+9:5588:x1875537603597312:12345-192.168.203.50@tcp:503: Request processed in 272us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652200.201900:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 167 00000100:00100000:2.0:1788652200.207865:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652200.208120:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603597440 00000100:00100000:3.0:1788652200.208132:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603597440 00000100:00100000:3.0:1788652200.208189:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 168 00000100:00100000:3.0:1788652200.208201:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+9:6059:x1875537603597440:12345-192.168.203.50@tcp:502: 00000100:00100000:3.0:1788652200.208608:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+9:6059:x1875537603597440:12345-192.168.203.50@tcp:502: Request processed in 407us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652200.208616:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 168 00000100:00100000:2.0:1788652200.211535:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652200.211672:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603597568 00000100:00100000:0.0:1788652200.211681:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603597568 00000100:00100000:0.0:1788652200.211736:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 169 00000100:00100000:0.0:1788652200.211746:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+9:6059:x1875537603597568:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788652200.212051:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+9:6059:x1875537603597568:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 299us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652200.212063:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 169 00000100:00100000:0.0:1788652200.221902:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652200.222195:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603597696 00000100:00100000:3.0:1788652200.222207:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603597696 00000100:00100000:3.0:1788652200.222268:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 170 00000100:00100000:3.0:1788652200.222278:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+9:5588:x1875537603597696:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652200.222295:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652200.222314:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7a0e4600/0x340ed74ef02a75ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f07a2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652200.222342:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7a0e4600/0x340ed74ef02a75ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07a2 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652200.222354:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7a0e4600/0x340ed74ef02a75ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07a2 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652200.222364:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e4600, rc 0) 00000100:00100000:3.0:1788652200.222425:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:5588:x1875537603597696:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 Request processed in 148us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652200.222433:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 170 00000100:00100000:2.0:1788652200.233640:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652200.235200:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603597824 00000100:00100000:1.0:1788652200.235217:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603597824 00000100:00100000:1.0:1788652200.235298:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 171 00000100:00100000:1.0:1788652200.235309:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:5588:x1875537603597824:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788652200.236908:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:5588:x1875537603597824:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 Request processed in 1591us (3270us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788652200.236922:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 171 00000100:00100000:2.0:1788652201.096185:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788652201.096211:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a21a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627742592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788652201.096291:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652201.097034:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627742592 00000100:00100000:3.0:1788652201.097045:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627742592 00000100:00100000:3.0:1788652201.097130:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788652201.097141:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627742592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788652201.097184:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652201.097249:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627742592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652201.097272:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788652201.098143:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788652201.098192:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a21a680 x1875537627742592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652201.098227:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a21a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627742592:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788652201.223989:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788652202.079664:0:8495:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe983ec2c0 20000000:00000080:1.0:1788652202.079686:0:8495:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cbe7f627c00 uarg=0000000000000000 20000000:01000000:1.0:1788652202.079735:0:8495:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788652202.079743:0:8495:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788652202.079749:0:8495:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788652202.081685:0:8496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788652202.082223:0:8495:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788652202.092251:0:8495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788652202.092690:0:8495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788652202.092759:0:8495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788652202.092944:0:8495:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788652202.092974:0:8495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbe52924400/0x340ed74ef02a75c1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.092997:0:8495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe49e56000/0x340ed74ef02a7336 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a732f expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.093006:0:8495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe49e56e00/0x340ed74ef02a7398 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a7391 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.093027:0:8495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe52925000/0x340ed74ef02a7463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a745c expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.093039:0:8495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe8215e200/0x340ed74ef02a7520 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f076a expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.093048:0:8495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbe52924400/0x340ed74ef02a75c1 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.093106:0:8495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe8215e200/0x340ed74ef02a7520 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f076a expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.093122:0:8495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe8215e200/0x340ed74ef02a7520 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f076a expref: 9 pid: 5830 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652202.093138:0:8495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422ca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8495:1875537627742720:192.168.203.50@tcp:104: 00010000:00010000:1.0:1788652202.093310:0:8495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe52925000/0x340ed74ef02a7463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a745c expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.093316:0:8495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe52925000/0x340ed74ef02a7463 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a745c expref: 18 pid: 5830 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652202.093324:0:8495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8495:1875537627742848:0@lo:104: 00000100:00100000:1.0:1788652202.093362:0:8495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788652202.093699:0:8495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe49e56e00/0x340ed74ef02a7398 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a7391 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.093709:0:8495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe49e56e00/0x340ed74ef02a7398 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a7391 expref: 18 pid: 5830 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652202.093731:0:8495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422caa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8495:1875537627742976:0@lo:104: 00000100:00100000:1.0:1788652202.093806:0:8495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788652202.094231:0:8495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe49e56000/0x340ed74ef02a7336 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a732f expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.094242:0:8495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe49e56000/0x340ed74ef02a7336 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a732f expref: 18 pid: 5828 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652202.094251:0:8495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8495:1875537627743104:0@lo:104: 00000100:00100000:1.0:1788652202.094275:0:8495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb000 going to sleep for 11 seconds 00000100:00100000:3.0:1788652202.094429:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788652202.094454:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652202.094469:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627742848 00000100:00100000:3.0:1788652202.094479:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627742848 00000100:00100000:3.0:1788652202.094526:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627742976 00000100:00100000:3.0:1788652202.094530:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627742976 00000100:00100000:3.0:1788652202.094540:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627743104 00000100:00100000:3.0:1788652202.094543:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627743104 00000100:00100000:3.0:1788652202.094559:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788652202.094568:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+5:8495:x1875537627742848:12345-0@lo:104: 00010000:00010000:3.0:1788652202.094585:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b600/0x340ed74ef02a745c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a7463 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652202.094693:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788652202.094700:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+5:8495:x1875537627742848:12345-0@lo:104: Request processed in 133us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652202.094707:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788652202.094729:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788652202.094735:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+4:8495:x1875537627742976:12345-0@lo:104: 00010000:00010000:3.0:1788652202.094750:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe52925600/0x340ed74ef02a7391 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a7398 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652202.094961:0:8495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8495:1875537627742848:0@lo:104: 00000100:00100000:1.0:1788652202.094972:0:8495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422caa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8495:1875537627742976:0@lo:104: 00000100:00100000:2.0:1788652202.095024:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:2.0:1788652202.095031:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788652202.095040:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1788652202.095254:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788652202.095263:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b600/0x340ed74ef02a745c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a7463 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.095271:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151b600 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:0.0:1788652202.095284:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b600/0x340ed74ef02a745c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a7463 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.095294:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b600/0x340ed74ef02a745c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a7463 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788652202.095302:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b600/0x340ed74ef02a745c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a7463 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652202.095309:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788652202.095357:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b600/0x340ed74ef02a745c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7463 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.095365:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788652202.095391:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b600/0x340ed74ef02a745c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7463 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.095398:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b600/0x340ed74ef02a745c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7463 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.095416:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652202.095419:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe52925600/0x340ed74ef02a7391 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a7398 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.095425:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe52925600 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:0.0:1788652202.095428:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe52925600/0x340ed74ef02a7391 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a7398 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.095435:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe52925600/0x340ed74ef02a7391 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a7398 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788652202.095452:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe52925600/0x340ed74ef02a7391 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a7398 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652202.095457:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788652202.095474:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe52925600/0x340ed74ef02a7391 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7398 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.095479:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788652202.095497:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe52925600/0x340ed74ef02a7391 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7398 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.095504:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe52925600/0x340ed74ef02a7391 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7398 expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.095515:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652202.095516:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652202.095519:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652202.095528:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788652202.095544:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627743232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788652202.095592:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652202.095643:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627743232 00000100:00100000:0.0:1788652202.095649:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627743232 00010000:00010000:0.0:1788652202.095679:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe52925000/0x340ed74ef02a7463 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a745c expref: 19 pid: 5830 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652202.095708:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788652202.095716:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+19:3303:x1875537627743232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788652202.095729:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652202.095742:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe52925000/0x340ed74ef02a7463 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a745c expref: 19 pid: 5830 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.095753:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe52925000/0x340ed74ef02a7463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a745c expref: 19 pid: 5830 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.095790:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe52925000/0x340ed74ef02a7463 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a745c expref: 19 pid: 5830 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.095807:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652202.095842:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+18:3303:x1875537627743232:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652202.095849:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788652202.095889:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627743232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788652202.095957:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788652202.095967:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627743360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788652202.095991:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652202.096019:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627743360 00000100:00100000:0.0:1788652202.096023:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627743360 00010000:00010000:0.0:1788652202.096037:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe49e56e00/0x340ed74ef02a7398 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a7391 expref: 18 pid: 5830 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652202.096054:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788652202.096060:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f811a652-691e-4a40-b660-977a4758dd08+18:3306:x1875537627743360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788652202.096067:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652202.096070:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe49e56e00/0x340ed74ef02a7398 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a7391 expref: 18 pid: 5830 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.096078:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe49e56e00/0x340ed74ef02a7398 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a7391 expref: 18 pid: 5830 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.096094:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe49e56e00/0x340ed74ef02a7398 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a7391 expref: 18 pid: 5830 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.096104:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652202.096130:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f811a652-691e-4a40-b660-977a4758dd08+17:3306:x1875537627743360:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652202.096137:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788652202.096160:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627743360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788652202.096474:0:8497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788652202.096483:0:8497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a21b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f811a652-691e-4a40-b660-977a4758dd08+4:8495:x1875537627743104:12345-0@lo:104: 00010000:00010000:0.0:1788652202.096496:0:8497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a732f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a7336 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.096596:0:8497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788652202.096603:0:8497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a21b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f811a652-691e-4a40-b660-977a4758dd08+4:8495:x1875537627743104:12345-0@lo:104: Request processed in 122us (2149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652202.096610:0:8497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788652202.096664:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652202.096672:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a732f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a7336 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652202.096680:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e57800 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:2.0:1788652202.096684:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a732f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a7336 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652202.096692:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a732f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a7336 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652202.096699:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a732f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a7336 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652202.096716:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788652202.096755:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a732f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7336 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652202.096762:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652202.096802:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a732f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7336 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652202.096809:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a732f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7336 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652202.096822:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652202.096824:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652202.096826:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652202.096836:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627743488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652202.096867:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652202.096906:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627743488 00000100:00100000:2.0:1788652202.096911:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627743488 00010000:00010000:2.0:1788652202.096933:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe49e56000/0x340ed74ef02a7336 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a732f expref: 17 pid: 5828 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652202.096954:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788652202.096960:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f811a652-691e-4a40-b660-977a4758dd08+17:3306:x1875537627743488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788652202.096969:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652202.096973:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe49e56000/0x340ed74ef02a7336 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a732f expref: 17 pid: 5828 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652202.096983:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe49e56000/0x340ed74ef02a7336 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a732f expref: 17 pid: 5828 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652202.097002:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652202.097029:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f811a652-691e-4a40-b660-977a4758dd08+17:3306:x1875537627743488:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652202.097036:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788652202.097066:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627743488:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788652202.097391:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652202.097582:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788652202.097593:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f811a652-691e-4a40-b660-977a4758dd08+3:8495:x1875537627742976:12345-0@lo:104: Request processed in 2856us (3821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652202.097602:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788652202.098180:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652202.098249:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603597952 00000100:00100000:0.0:1788652202.098257:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603597952 00010000:00010000:0.0:1788652202.098288:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe8215e200/0x340ed74ef02a7520 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f076a expref: 10 pid: 5830 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652202.098326:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 24 00000100:00100000:0.0:1788652202.098333:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:2347:x1875537603597952:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788652202.098348:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652202.098360:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe8215e200/0x340ed74ef02a7520 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f076a expref: 10 pid: 5830 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.098373:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe8215e200/0x340ed74ef02a7520 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f076a expref: 10 pid: 5830 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.098395:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbe52924400/0x340ed74ef02a75c1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.098405:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe52924400/0x340ed74ef02a75c1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.098424:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe52924400/0x340ed74ef02a75c1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.098432:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe52924400/0x340ed74ef02a75c1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.098440:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbe52924400/0x340ed74ef02a75c1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.098446:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbe52924400/0x340ed74ef02a75c1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.098452:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe52924400 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:0.0:1788652202.098458:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbe52924400/0x340ed74ef02a75c1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.098467:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbe52924400/0x340ed74ef02a75c1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.098476:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbe52924400/0x340ed74ef02a75c1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.098495:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652202.098556:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:2347:x1875537603597952:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 222us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652202.098564:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 24 00010000:00010000:1.0:1788652202.098716:0:8495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe49e56000/0x340ed74ef02a7336 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a732f expref: 16 pid: 5828 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652202.098731:0:8495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8495:1875537627743104:0@lo:104: 00010000:00010000:1.0:1788652202.098978:0:8495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe8215e200/0x340ed74ef02a7520 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f076a expref: 9 pid: 5830 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652202.098988:0:8495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422ca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8495:1875537627742720:192.168.203.50@tcp:104: 00010000:00010000:1.0:1788652202.099018:0:8495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbe52924400/0x340ed74ef02a75c1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.099028:0:8495:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbe52924400/0x340ed74ef02a75c1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.099035:0:8495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbe52924400/0x340ed74ef02a75c1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.099049:0:8495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe52924400/0x340ed74ef02a75c1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.265390:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652203.274283:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788652203.592174:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788652203.592186:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe7fdf4800 from 4 10000000:01000000:0.0:1788652203.592192:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788652203.592264:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a75c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652203.592279:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a75c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652203.592294:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a75c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652203.592329:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627743616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788652203.592430:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652203.592509:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe492f5300 going to sleep for 11 seconds 00000100:00100000:1.0:1788652203.593060:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627743616 00000100:00100000:1.0:1788652203.593072:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627743616 00000100:00100000:1.0:1788652203.593145:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788652203.593158:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+16:5832:x1875537627743616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788652203.593176:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652203.593197:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe52925c00/0x340ed74ef02a75cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a75c8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652203.593241:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe52925c00/0x340ed74ef02a75cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a75c8 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652203.593255:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe52925c00/0x340ed74ef02a75cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a75c8 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652203.593267:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe52925c00, rc 0) 00000100:00100000:1.0:1788652203.593342:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627743616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652203.593349:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788652203.593421:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627743616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788652203.593454:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a75c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a75cf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652203.593465:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a75c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a75cf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652203.593558:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627743744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788652203.593593:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652203.593624:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe47e11f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788652203.594062:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627743744 00000100:00100000:0.0:1788652203.594069:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627743744 00000100:00100000:0.0:1788652203.594111:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788652203.594120:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627743744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788652203.594470:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627743744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 349us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652203.594479:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788652203.594595:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627743744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788652203.594636:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627743872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788652203.594684:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652203.594725:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe47e11f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788652203.594809:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627743872 00000100:00100000:1.0:1788652203.594815:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627743872 00000100:00100000:1.0:1788652203.594849:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788652203.594859:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627743872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788652203.595063:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627743872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 205us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652203.595083:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788652203.595238:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627743872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788652203.600190:0:8547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8547:1875537627744000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788652203.600332:0:8547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652203.600382:0:8547:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe492f5900 going to sleep for 11 seconds 00000100:00100000:1.0:1788652203.600489:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627744000 00000100:00100000:1.0:1788652203.600500:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627744000 00000100:00100000:1.0:1788652203.600625:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788652203.600637:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+17:8547:x1875537627744000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788652203.600968:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+17:8547:x1875537627744000:12345-0@lo:502:llog_process_th.0 Request processed in 331us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652203.600976:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788652203.602369:0:8547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8547:1875537627744000:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788652203.602424:0:8547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788652203.602438:0:8547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652203.602441:0:8547:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788652203.602451:0:8547:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbe7fdf4800 00000020:00000080:0.0:1788652203.602454:0:8547:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788652203.607914:0:8547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8547:1875537627744128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788652203.613719:0:8547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652203.613764:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627744128 00000100:00100000:0.0:1788652203.613790:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627744128 00000100:00100000:1.0:1788652203.613801:0:8547:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788652203.616728:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788652203.616753:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+17:8547:x1875537627744128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788652203.617137:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+17:8547:x1875537627744128:12345-0@lo:502:llog_process_th.0 Request processed in 392us (3425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652203.617147:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788652203.617324:0:8547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8547:1875537627744128:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788652203.617372:0:8547:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652203.617382:0:8547:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652203.617385:0:8547:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788652203.617390:0:8547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788652203.617539:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788652203.617563:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788652203.617575:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a75c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a75cf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652203.617588:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a75c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a75cf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652203.617599:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788652203.617603:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe818bc800 from 4 10000000:01000000:0.0:1788652203.617606:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788652203.617646:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56800/0x340ed74ef02a75d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652203.617665:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56800/0x340ed74ef02a75d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652203.617678:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56800/0x340ed74ef02a75d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652203.617704:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627744256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788652203.617748:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652203.617828:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4a5d7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788652203.618057:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627744256 00000100:00100000:1.0:1788652203.618065:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627744256 00000100:00100000:1.0:1788652203.618118:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788652203.618129:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627744256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788652203.618141:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652203.618158:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe52924e00/0x340ed74ef02a75dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a75d6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652203.618185:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe52924e00/0x340ed74ef02a75dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a75d6 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652203.618221:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe52924e00/0x340ed74ef02a75dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a75d6 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652203.618232:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe52924e00, rc 0) 00000100:00100000:1.0:1788652203.618282:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627744256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652203.618289:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788652203.618316:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627744256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652203.618332:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56800/0x340ed74ef02a75d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a75dd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652203.618342:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56800/0x340ed74ef02a75d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a75dd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652203.618399:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627744384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788652203.618428:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652203.618537:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4a5d7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788652203.619722:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627744384 00000100:00100000:1.0:1788652203.619733:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627744384 00000100:00100000:1.0:1788652203.619805:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788652203.619815:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627744384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788652203.620244:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627744384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 429us (1813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652203.620255:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788652203.620622:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627744384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788652203.620681:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627744512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788652203.620733:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652203.620760:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4a5d7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788652203.621511:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627744512 00000100:00100000:1.0:1788652203.621520:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627744512 00000100:00100000:1.0:1788652203.621570:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788652203.621579:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627744512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788652203.621810:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627744512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 230us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652203.621818:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788652203.621943:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627744512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788652203.623518:0:8551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8551:1875537627744640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788652203.623610:0:8551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652203.623659:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627744640 00000100:00100000:1.0:1788652203.623667:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627744640 00000100:00100000:1.0:1788652203.625098:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788652203.625121:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+18:8551:x1875537627744640:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788652203.625449:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+18:8551:x1875537627744640:12345-0@lo:502:llog_process_th.0 Request processed in 335us (1838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652203.625458:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788652203.625533:0:8551:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652203.625565:0:8551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8551:1875537627744640:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788652203.625614:0:8551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788652203.625629:0:8551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652203.625633:0:8551:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788652203.625641:0:8551:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbe818bc800 00000020:00000080:1.0:1788652203.625644:0:8551:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788652203.625748:0:8551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8551:1875537627744768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788652203.625821:0:8551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652203.625844:0:8551:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652203.626082:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627744768 00000100:00100000:0.0:1788652203.626097:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627744768 00000100:00100000:0.0:1788652203.626212:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788652203.626221:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+18:8551:x1875537627744768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788652203.626654:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+18:8551:x1875537627744768:12345-0@lo:502:llog_process_th.0 Request processed in 433us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652203.626663:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788652203.626827:0:8551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8551:1875537627744768:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788652203.626855:0:8551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652203.626863:0:8551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652203.626865:0:8551:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788652203.626870:0:8551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788652203.627811:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788652203.627847:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788652203.627863:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56800/0x340ed74ef02a75d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a75dd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652203.627888:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56800/0x340ed74ef02a75d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a75dd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652203.627901:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788652203.627904:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe50c46000 from 4 10000000:01000000:2.0:1788652203.627908:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788652203.627953:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a75e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652203.627962:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a75e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652203.627974:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a75e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652203.628002:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627744896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788652203.628067:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652203.628111:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe47e11f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788652203.628137:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627744896 00000100:00100000:2.0:1788652203.628145:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627744896 00000100:00100000:2.0:1788652203.628208:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788652203.628219:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627744896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788652203.628233:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652203.628249:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a75eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a75e4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652203.628278:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a75eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a75e4 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652203.628302:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a75eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a75e4 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652203.628313:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215f800, rc 0) 00000100:00100000:2.0:1788652203.628351:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:5832:x1875537627744896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652203.628358:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788652203.628513:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627744896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788652203.628528:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a75e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a75eb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652203.628547:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a75e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a75eb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652203.628606:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627745024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788652203.628635:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652203.628656:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe47e11f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788652203.628830:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627745024 00000100:00100000:0.0:1788652203.628836:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627745024 00000100:00100000:0.0:1788652203.628868:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788652203.628875:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+19:5832:x1875537627745024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788652203.629193:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+19:5832:x1875537627745024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 317us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652203.629212:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788652203.629247:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627745024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788652203.629298:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627745152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788652203.629341:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652203.629356:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627745152 00000100:00100000:0.0:1788652203.629356:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4943c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652203.629360:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627745152 00000100:00100000:1.0:1788652203.629386:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788652203.629393:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:5832:x1875537627745152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788652203.629564:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:5832:x1875537627745152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652203.629571:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788652203.629714:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627745152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788652203.630718:0:8553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8553:1875537627745280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788652203.630802:0:8553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652203.630838:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627745280 00000100:00100000:0.0:1788652203.630844:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627745280 00000100:00100000:0.0:1788652203.630890:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788652203.630899:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:8553:x1875537627745280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788652203.631335:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:8553:x1875537627745280:12345-0@lo:502:llog_process_th.0 Request processed in 435us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652203.634214:0:8553:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4943ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788652203.634269:0:8553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8553:1875537627745280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788652203.634328:0:8553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652203.634342:0:8553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652203.634344:0:8553:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788652203.634352:0:8553:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbe50c46000 00000020:00000080:3.0:1788652203.634355:0:8553:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788652203.636434:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788652203.636925:0:8553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a21ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8553:1875537627745408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788652203.637023:0:8553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652203.637077:0:8553:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7f320300 going to sleep for 11 seconds 00000100:00100000:1.0:1788652203.637085:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627745408 00000100:00100000:1.0:1788652203.637097:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627745408 00000100:00100000:1.0:1788652203.637159:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788652203.637170:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+19:8553:x1875537627745408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788652203.637453:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+19:8553:x1875537627745408:12345-0@lo:502:llog_process_th.0 Request processed in 284us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652203.637461:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788652203.637657:0:8553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a21ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:8553:1875537627745408:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788652203.637696:0:8553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652203.637706:0:8553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652203.637709:0:8553:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788652203.637715:0:8553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788652203.641307:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788652203.641353:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788652203.641366:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a75e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a75eb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652203.641380:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a75e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a75eb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652203.761044:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652203.761879:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603598080 00000100:00100000:0.0:1788652203.761894:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603598080 00000100:00100000:0.0:1788652203.761978:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 187 00000100:00100000:0.0:1788652203.761991:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+9:5588:x1875537603598080:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652203.762015:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652203.762039:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe49e56a00/0x340ed74ef02a75f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f07a9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652203.762078:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe49e56a00/0x340ed74ef02a75f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07a9 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652203.762092:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe49e56a00/0x340ed74ef02a75f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07a9 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652203.762103:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e56a00, rc 0) 00000100:00100000:0.0:1788652203.762177:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:5588:x1875537603598080:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 Request processed in 189us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652203.762186:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 187 00000100:00100000:3.0:1788652203.765812:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652203.765855:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603598208 00000100:00100000:3.0:1788652203.765869:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603598208 00000100:00100000:3.0:1788652203.765928:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 188 00000100:00100000:3.0:1788652203.765940:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:5588:x1875537603598208:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652203.766382:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:5588:x1875537603598208:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 Request processed in 441us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652203.766391:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 188 00000100:00100000:3.0:1788652203.768314:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652203.768351:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603598336 00000100:00100000:3.0:1788652203.768362:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603598336 00000100:00100000:3.0:1788652203.768422:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 189 00000100:00100000:3.0:1788652203.768433:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:5588:x1875537603598336:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788652203.768670:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:5588:x1875537603598336:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 Request processed in 238us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652203.768680:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 189 00000100:00100000:3.0:1788652203.772762:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652203.773634:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603598464 00000100:00100000:1.0:1788652203.773648:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603598464 00000100:00100000:1.0:1788652203.773714:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 190 00000100:00100000:1.0:1788652203.773728:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:6122:x1875537603598464:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788652203.774488:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:6122:x1875537603598464:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 760us (1741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652203.774499:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 190 00000100:00100000:3.0:1788652203.784077:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652203.784142:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603598592 00000100:00100000:1.0:1788652203.784156:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603598592 00000100:00100000:1.0:1788652203.784232:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 191 00000100:00100000:1.0:1788652203.784244:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:6122:x1875537603598592:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788652203.784547:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:6122:x1875537603598592:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 303us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652203.784555:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 191 00010000:00010000:0.0:1788652204.297058:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652204.680014:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627745536:0@lo:400:kworker.0 00000100:00100000:1.0:1788652204.680088:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652204.680307:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627745664:0@lo:400:kworker.0 00000100:00100000:2.0:1788652204.680342:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652204.680386:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627745664 00000100:00100000:2.0:1788652204.680394:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627745664 00000100:00100000:2.0:1788652204.680442:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788652204.680451:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627745664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652204.680500:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627745664:12345-0@lo:400:kworker.0 Request processed in 50us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652204.680518:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788652204.680560:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627745664:0@lo:400:kworker.0 00000100:00100000:1.0:1788652204.686469:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627745536 00000100:00100000:1.0:1788652204.686496:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627745536 00000100:00100000:1.0:1788652204.686564:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788652204.686576:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:3303:x1875537627745536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652204.686664:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:3303:x1875537627745536:12345-0@lo:400:kworker.0 Request processed in 92us (6576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652204.686671:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788652204.686729:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627745536:0@lo:400:kworker.0 00000100:00100000:1.0:1788652204.687578:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875537627746048:0@lo:400:kworker.0 00000100:00100000:1.0:1788652204.687623:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652204.687662:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788652204.687669:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627746176:0@lo:400:kworker.0 00000100:00100000:1.0:1788652204.687693:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652204.687723:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627746176 00000100:00100000:1.0:1788652204.687728:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627746176 00000100:00100000:1.0:1788652204.687882:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788652204.687890:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627746176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652204.687935:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627746176:12345-0@lo:400:kworker.0 Request processed in 46us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652204.687942:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788652204.687961:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788652204.687997:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7f2c3480 x1875537627746176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652204.688010:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627746176:0@lo:400:kworker.0 00000100:00100000:0.0:1788652204.688089:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627746048 00000100:00100000:0.0:1788652204.688094:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627746048 00000100:00100000:0.0:1788652204.688126:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788652204.688133:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875537627746048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652204.688170:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875537627746048:12345-0@lo:400:kworker.0 Request processed in 39us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652204.688176:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788652204.688957:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788652204.688987:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875537627746048:0@lo:400:kworker.0 00000100:00100000:2.0:1788652204.689074:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627745792:0@lo:400:kworker.0 00000100:00100000:2.0:1788652204.689112:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652204.690903:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788652204.690924:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627745920:0@lo:400:kworker.0 00000100:00100000:2.0:1788652204.690976:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652204.691218:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627745920 00000100:00100000:1.0:1788652204.691225:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627745920 00000100:00100000:1.0:1788652204.691279:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788652204.691287:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627745920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652204.691341:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627745920:12345-0@lo:400:kworker.0 Request processed in 55us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652204.691348:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788652204.691623:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7f2c0000 x1875537627745920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652204.691636:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627745920:0@lo:400:kworker.0 00000100:00080000:2.0:1788652204.691658:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788652204.692141:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627745792 00000100:00100000:0.0:1788652204.692148:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627745792 00000100:00100000:1.0:1788652204.692351:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788652204.692360:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627745792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652204.692415:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627745792:12345-0@lo:400:kworker.0 Request processed in 57us (3302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652204.692421:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788652204.692493:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627745792:0@lo:400:kworker.0 00000100:00080000:2.0:1788652204.692512:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652205.192407:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788652205.194046:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627746304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788652205.194123:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652205.194536:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627746304 00000100:00100000:1.0:1788652205.194546:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627746304 00000100:00100000:1.0:1788652205.194600:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788652205.194609:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627746304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788652205.194643:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788652205.194702:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627746304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652205.194709:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788652205.194811:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbd422caa00 x1875537627746304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652221 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652205.194830:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627746304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788652205.234058:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652205.234115:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652205.234217:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652205.234266:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652205.234320:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603598720 00000100:00100000:2.0:1788652205.234332:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603598720 00000100:00100000:2.0:1788652205.234388:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 193 00000100:00100000:2.0:1788652205.234398:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:2346:x1875537603598720:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652205.234481:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:2346:x1875537603598720:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 84us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652205.234488:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 193 00000100:00100000:0.0:1788652205.235452:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603598848 00000100:00100000:0.0:1788652205.235462:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603598848 00000100:00100000:0.0:1788652205.235522:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 33 00000100:00100000:0.0:1788652205.235531:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a21a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2346:x1875537603598848:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1788652205.235585:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a21a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2346:x1875537603598848:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 55us (1538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652205.235659:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 33 00000100:00080000:0.0:1788652205.235689:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788652205.240582:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603599104 00000100:00100000:1.0:1788652205.240600:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603599104 00000100:00080000:2.0:1788652205.240709:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788652205.242808:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603598976 00000100:00100000:0.0:1788652205.242824:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603598976 00000100:00100000:0.0:1788652205.242988:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:0.0:1788652205.243000:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2346:x1875537603599104:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1788652205.243087:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2346:x1875537603599104:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 90us (8969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652205.243094:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:0.0:1788652205.243112:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:0.0:1788652205.243119:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2346:x1875537603598976:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1788652205.243163:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2346:x1875537603598976:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 45us (8897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652205.243170:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00080000:2.0:1788652205.244380:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788652205.320385:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652206.232485:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788652206.232512:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a21a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627746432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788652206.232581:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652206.232647:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627746432 00000100:00100000:3.0:1788652206.232654:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627746432 00000100:00100000:3.0:1788652206.232709:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788652206.232719:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627746432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788652206.232752:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652206.232818:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627746432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652206.232825:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788652206.232846:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788652206.232877:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a21a300 x1875537627746432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652206.232905:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a21a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627746432:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788652206.345166:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652207.368633:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652208.392576:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788652209.361186:0:8795:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1788652209.417439:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652209.805432:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627746560:0@lo:400:kworker.0 00000100:00100000:2.0:1788652209.805525:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652209.805657:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627746560 00000100:00100000:3.0:1788652209.805667:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627746560 00000100:00100000:3.0:1788652209.805728:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788652209.805738:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+19:3303:x1875537627746560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652209.810499:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627746688:0@lo:400:kworker.0 00000100:00100000:0.0:1788652209.810566:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652209.810642:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627746688 00000100:00100000:0.0:1788652209.810651:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627746688 00000100:00100000:0.0:1788652209.810699:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788652209.810707:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627746688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652209.810756:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627746688:12345-0@lo:400:kworker.0 Request processed in 49us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652209.810763:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788652209.810825:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627746688:0@lo:400:kworker.0 00000100:00100000:3.0:1788652209.813990:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+19:3303:x1875537627746560:12345-0@lo:400:kworker.0 Request processed in 8244us (8454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652209.814007:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788652209.814087:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627746816:0@lo:400:kworker.0 00000100:00100000:1.0:1788652209.814087:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627746944:0@lo:400:kworker.0 00000100:00100000:3.0:1788652209.814150:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652209.814222:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627746816 00000100:00100000:3.0:1788652209.814230:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627746816 00000100:00100000:1.0:1788652209.814248:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652209.814294:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788652209.814304:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627746944 00000100:00100000:3.0:1788652209.814307:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a21a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627746816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652209.814310:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627746944 00000100:00100000:1.0:1788652209.814363:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788652209.814373:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a21a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627746816:12345-0@lo:400:kworker.0 Request processed in 69us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652209.814383:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788652209.814390:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627746944:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788652209.814434:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788652209.814440:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788652209.814452:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627746944:12345-0@lo:400:kworker.0 Request processed in 54us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652209.814461:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788652209.814485:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627746816:0@lo:400:kworker.0 00000100:00100000:3.0:1788652209.814541:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627747200:0@lo:400:kworker.0 00000100:00100000:3.0:1788652209.814572:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652209.814601:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00080000:1.0:1788652209.814618:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbd422ca300 x1875537627746944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652209.814619:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875537627747072:0@lo:400:kworker.0 00000100:00100000:1.0:1788652209.814636:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627746944:0@lo:400:kworker.0 00000100:00100000:3.0:1788652209.814656:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652209.814698:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627747200 00000100:00100000:3.0:1788652209.814702:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627747072 00000100:00100000:1.0:1788652209.814704:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627747200 00000100:00100000:3.0:1788652209.814708:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627747072 00000100:00100000:1.0:1788652209.814752:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788652209.814760:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788652209.814765:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a21aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627747200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652209.814803:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875537627747072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652209.814842:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a21aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627747200:12345-0@lo:400:kworker.0 Request processed in 80us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652209.814850:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788652209.814857:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875537627747072:12345-0@lo:400:kworker.0 Request processed in 85us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652209.814866:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788652209.814892:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788652209.814897:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788652209.814929:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875537627747072:0@lo:400:kworker.0 00010000:00080000:3.0:1788652209.814947:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbd422c8380 x1875537627747200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652209.814959:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627747200:0@lo:400:kworker.0 00000100:00100000:2.0:1788652209.825277:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627746560:0@lo:400:kworker.0 00000100:00100000:3.0:1788652210.315130:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627747328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788652210.315206:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652210.315303:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627747328 00000100:00100000:0.0:1788652210.315311:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627747328 00000100:00100000:0.0:1788652210.315361:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788652210.315370:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a21b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627747328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788652210.315403:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788652210.316047:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a21b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627747328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 674us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652210.316058:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788652210.316137:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbd422ca300 x1875537627747328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652226 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652210.316168:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627747328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788652210.353553:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652210.353961:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652210.353997:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652210.354023:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652210.354052:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603599616 00000100:00100000:3.0:1788652210.354057:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603599360 00000100:00100000:3.0:1788652210.354062:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603599360 00000100:00100000:1.0:1788652210.354062:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603599616 00000100:00100000:1.0:1788652210.354120:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603599488 00000100:00100000:1.0:1788652210.354123:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603599488 00000100:00100000:3.0:1788652210.354125:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 37 00000100:00100000:3.0:1788652210.354135:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2349:x1875537603599360:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652210.354142:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 22 00000100:00100000:1.0:1788652210.354147:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2349:x1875537603599616:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652210.354222:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2349:x1875537603599616:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 70us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652210.354236:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603599232 00000100:00100000:2.0:1788652210.354239:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603599232 00000100:00100000:1.0:1788652210.354242:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 22 00000100:00100000:1.0:1788652210.354257:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:2.0:1788652210.354263:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 195 00000100:00100000:1.0:1788652210.354263:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2349:x1875537603599488:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652210.354269:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:2349:x1875537603599232:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1788652210.355658:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2349:x1875537603599360:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 1512us (2106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652210.355686:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 37 00000100:00080000:3.0:1788652210.355901:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788652210.355978:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788652210.355981:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788652210.356243:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2349:x1875537603599488:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 1976us (2216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652210.356253:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:2.0:1788652210.356444:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:2349:x1875537603599232:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 2172us (2444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652210.356453:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 195 00010000:00010000:2.0:1788652210.443754:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652211.336793:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788652211.336936:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627747456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788652211.337011:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652211.339431:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627747456 00000100:00100000:0.0:1788652211.339467:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627747456 00000100:00100000:0.0:1788652211.339721:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788652211.339733:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a21bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627747456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788652211.339791:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788652211.339881:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a21bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627747456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (2869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652211.339889:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788652211.339931:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7f2c2300 x1875537627747456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652211.339953:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627747456:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788652211.340010:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788652211.467109:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652212.489037:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652213.512673:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652214.545399:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652214.919998:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627747584:0@lo:400:kworker.0 00000100:00100000:3.0:1788652214.920072:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652214.920160:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627747584 00000100:00100000:2.0:1788652214.920168:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627747584 00000100:00100000:2.0:1788652214.920218:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788652214.920228:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+19:3303:x1875537627747584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652214.922142:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+19:3303:x1875537627747584:12345-0@lo:400:kworker.0 Request processed in 1897us (2051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652214.922156:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788652214.922886:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627747840:0@lo:400:kworker.0 00000100:00100000:2.0:1788652214.922958:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652214.922995:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788652214.923001:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627747968:0@lo:400:kworker.0 00000100:00100000:2.0:1788652214.923033:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652214.923065:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627747840 00000100:00100000:2.0:1788652214.923072:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627747840 00000100:00100000:1.0:1788652214.923107:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627747712:0@lo:400:kworker.0 00000100:00100000:2.0:1788652214.923146:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788652214.923157:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652214.923160:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627747840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652214.923187:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627748224:0@lo:400:kworker.0 00000100:00100000:2.0:1788652214.923218:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627747840:12345-0@lo:400:kworker.0 Request processed in 63us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652214.923223:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652214.923231:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788652214.923249:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627747712 00000100:00100000:2.0:1788652214.923253:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627747712 00000100:00100000:2.0:1788652214.923277:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788652214.923284:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627747712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652214.923321:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788652214.923327:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627747712:12345-0@lo:400:kworker.0 Request processed in 42us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652214.923332:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b191880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875537627748096:0@lo:400:kworker.0 00000100:00100000:2.0:1788652214.923338:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788652214.923366:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652214.923371:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627747968 00000100:00100000:2.0:1788652214.923376:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627747968 00000100:00100000:1.0:1788652214.923404:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627747712:0@lo:400:kworker.0 00000100:00100000:2.0:1788652214.923413:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627748224 00000100:00100000:2.0:1788652214.923417:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627748224 00000100:00100000:1.0:1788652214.923441:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627748096 00000100:00100000:1.0:1788652214.923446:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627748096 00000100:00100000:2.0:1788652214.923447:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788652214.923459:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627747968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652214.923478:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788652214.923495:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627747968:12345-0@lo:400:kworker.0 Request processed in 39us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652214.923501:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875537627748096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652214.923506:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788652214.923529:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788652214.923537:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627748224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652214.923548:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875537627748096:12345-0@lo:400:kworker.0 Request processed in 62us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652214.923556:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788652214.923577:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627748224:12345-0@lo:400:kworker.0 Request processed in 41us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652214.923585:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788652214.923603:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b191880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875537627748096:0@lo:400:kworker.0 00000100:00080000:2.0:1788652214.923607:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788652214.923613:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788652214.923616:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788652214.923618:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe4b190a80 x1875537627748224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652214.923636:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627748224:0@lo:400:kworker.0 00010000:00080000:2.0:1788652214.923640:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbd422caa00 x1875537627747968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652214.923652:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627747968:0@lo:400:kworker.0 00000100:00100000:2.0:1788652214.923666:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627747840:0@lo:400:kworker.0 00000100:00100000:3.0:1788652214.924210:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627747584:0@lo:400:kworker.0 00000001:02000400:2.0:1788652215.033491:0:9039:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing yml_node 00000100:00100000:3.0:1788652215.433792:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788652215.433815:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627748352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788652215.433883:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652215.434847:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627748352 00000100:00100000:2.0:1788652215.434858:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627748352 00000100:00100000:2.0:1788652215.434907:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788652215.434917:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627748352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788652215.434950:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788652215.435020:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627748352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652215.435027:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788652215.437103:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a405500 x1875537627748352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652231 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652215.437139:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627748352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788652215.486218:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652215.487514:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652215.487641:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652215.487734:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652215.487789:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603599872 00000100:00100000:2.0:1788652215.487816:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603599872 00000100:00100000:2.0:1788652215.487883:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 41 00000100:00100000:2.0:1788652215.487894:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2348:x1875537603599872:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652215.487969:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2348:x1875537603599872:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 76us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652215.487977:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 41 00000100:00100000:2.0:1788652215.488014:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603600000 00000100:00100000:2.0:1788652215.488019:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603600000 00000100:00100000:2.0:1788652215.488051:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603600128 00000100:00100000:2.0:1788652215.488055:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603600128 00000100:00100000:0.0:1788652215.488064:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:0.0:1788652215.488076:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2345:x1875537603600000:12345-192.168.203.50@tcp:9:kworker.0 00000020:00000080:0.0:1788652215.488107:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a752e 00000100:00080000:0.0:1788652215.488129:0:6678:0:(import.c:65:import_set_state_nolock()) ffff8cbe512cb000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788652215.488167:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788652215.488220:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:2.0:1788652215.488229:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2345:x1875537603600128:12345-192.168.203.50@tcp:9:kworker.0 00000020:00000080:2.0:1788652215.488250:0:8297:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a7535 00000100:00080000:2.0:1788652215.488259:0:8297:0:(import.c:65:import_set_state_nolock()) ffff8cbe512ca000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788652215.488310:0:8297:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788652215.488570:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+2:2345:x1875537603600000:12345-192.168.203.50@tcp:9:kworker.0 Request processed in 496us (2366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652215.488579:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:2.0:1788652215.488643:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+2:2345:x1875537603600128:12345-192.168.203.50@tcp:9:kworker.0 Request processed in 413us (907us total) trans 0 rc 0/0 00010000:00010000:0.0:1788652215.488651:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652215.488652:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00080000:2.0:1788652215.488675:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788652215.488679:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788652215.488681:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652215.490058:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603599744 00000100:00100000:3.0:1788652215.490070:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603599744 00000100:00100000:3.0:1788652215.490200:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 197 00000100:00100000:3.0:1788652215.490209:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:2348:x1875537603599744:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1788652215.490255:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:2348:x1875537603599744:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 48us (3988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652215.490261:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 197 00010000:00010000:2.0:1788652215.491192:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652215.561020:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652216.469041:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd41faa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627748480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788652216.469109:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652216.469751:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627748480 00000100:00100000:0.0:1788652216.469761:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627748480 00000100:00100000:0.0:1788652216.469841:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788652216.469851:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627748480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788652216.469888:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788652216.470030:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b190a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627748480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 180us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652216.470037:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788652216.470071:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788652216.470104:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbd41faa300 x1875537627748480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652216.470132:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd41faa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627748480:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1788652216.513185:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c 00000020:00000080:2.0:1788652216.513195:0:6704:0:(genops.c:885:class_export_put()) final put ffff8cbe512cf000/20ec7f44-aadf-40d6-8a9c-d109a8b21d8c 00000020:00000080:1.0:1788652216.513275:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe512cf000/20ec7f44-aadf-40d6-8a9c-d109a8b21d8c for lustre-OST0000 00000020:00000080:1.0:1788652216.513398:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe512cb000 for lustre-OST0000 00010000:00010000:2.0:1788652216.586667:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652217.612862:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652218.642149:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788652219.208647:0:9233:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00000001:00100000:1.0:1788652219.571814:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c 00000020:00000080:1.0:1788652219.571823:0:7631:0:(genops.c:885:class_export_put()) final put ffff8cbe512c9000/20ec7f44-aadf-40d6-8a9c-d109a8b21d8c 00000020:00000080:2.0:1788652219.572456:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe512c9000/20ec7f44-aadf-40d6-8a9c-d109a8b21d8c for lustre-OST0001 00000020:00000080:2.0:1788652219.572518:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe512ca000 for lustre-OST0001 00010000:00010000:1.0:1788652219.656112:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652220.040169:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627748864:0@lo:400:kworker.0 00000100:00100000:0.0:1788652220.040238:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652220.040287:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788652220.040292:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627748992:0@lo:400:kworker.0 00000100:00100000:0.0:1788652220.040315:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652220.040347:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627748864 00000100:00100000:0.0:1788652220.040353:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627748864 00000100:00100000:0.0:1788652220.040402:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788652220.040411:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627748864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652220.040454:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627748864:12345-0@lo:400:kworker.0 Request processed in 45us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652220.040461:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788652220.040482:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627748992 00000100:00100000:0.0:1788652220.040485:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627748992 00000100:00100000:0.0:1788652220.040510:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788652220.040516:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627748992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652220.040543:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627748992:12345-0@lo:400:kworker.0 Request processed in 27us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652220.040548:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788652220.040561:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788652220.040565:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788652220.040594:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7f2c0e00 x1875537627748992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652220.040615:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627748992:0@lo:400:kworker.0 00000100:00100000:0.0:1788652220.040626:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627748864:0@lo:400:kworker.0 00000100:00100000:2.0:1788652220.040685:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627748608:0@lo:400:kworker.0 00000100:00100000:2.0:1788652220.040715:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652220.040746:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875537627749120:0@lo:400:kworker.0 00000100:00100000:2.0:1788652220.040765:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652220.040812:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788652220.040817:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627748736:0@lo:400:kworker.0 00000100:00100000:2.0:1788652220.040836:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652220.040850:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627749248:0@lo:400:kworker.0 00000100:00100000:2.0:1788652220.040866:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652220.040885:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627749120 00000100:00100000:2.0:1788652220.040888:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627749120 00000100:00100000:2.0:1788652220.040908:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627748736 00000100:00100000:2.0:1788652220.040910:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627748736 00000100:00100000:2.0:1788652220.040922:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788652220.040927:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875537627749120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652220.040956:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875537627749120:12345-0@lo:400:kworker.0 Request processed in 29us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652220.040962:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788652220.040972:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788652220.040977:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627748736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652220.040997:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627748736:12345-0@lo:400:kworker.0 Request processed in 20us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652220.041003:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788652220.041018:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627749248 00000100:00100000:2.0:1788652220.041021:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627749248 00000100:00100000:2.0:1788652220.041041:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788652220.041046:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627749248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652220.041078:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627749248:12345-0@lo:400:kworker.0 Request processed in 32us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652220.041084:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788652220.041126:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627748736:0@lo:400:kworker.0 00010000:00080000:2.0:1788652220.041136:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7f2c0380 x1875537627749248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652220.041144:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627749248:0@lo:400:kworker.0 00000100:00100000:2.0:1788652220.041152:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875537627749120:0@lo:400:kworker.0 00000100:00100000:0.0:1788652220.041271:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627748608 00000100:00100000:0.0:1788652220.041275:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627748608 00000100:00100000:0.0:1788652220.041311:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788652220.041318:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:3303:x1875537627748608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652220.041362:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:3303:x1875537627748608:12345-0@lo:400:kworker.0 Request processed in 45us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652220.041368:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:0.0:1788652220.041394:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788652220.041398:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788652220.041446:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627748608:0@lo:400:kworker.0 00000100:00100000:1.0:1788652220.552111:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788652220.552137:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627749376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788652220.552207:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652220.552393:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627749376 00000100:00100000:3.0:1788652220.552401:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627749376 00000100:00100000:3.0:1788652220.552455:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788652220.552464:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627749376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788652220.552516:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652220.552563:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627749376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652220.552570:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788652220.552618:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a407800 x1875537627749376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652236 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652220.552634:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627749376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788652220.594162:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652220.594212:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652220.594312:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603600256 00000100:00100000:0.0:1788652220.594322:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603600256 00000100:00100000:0.0:1788652220.594381:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 199 00000100:00100000:0.0:1788652220.594391:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:2348:x1875537603600256:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1788652220.594464:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:2348:x1875537603600256:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 75us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652220.594473:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 199 00000100:00100000:3.0:1788652220.594483:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603600384 00000100:00100000:3.0:1788652220.594489:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603600384 00000100:00080000:0.0:1788652220.594512:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652220.594539:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 45 00000100:00100000:3.0:1788652220.594550:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2348:x1875537603600384:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1788652220.594587:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2348:x1875537603600384:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 39us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652220.594594:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 45 00010000:00010000:2.0:1788652220.681684:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652221.578551:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627749504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788652221.578616:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652221.578698:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627749504 00000100:00100000:1.0:1788652221.578706:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627749504 00000100:00100000:1.0:1788652221.578752:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788652221.578761:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627749504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788652221.578812:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788652221.578863:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627749504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652221.578871:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788652221.578909:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe4b193480 x1875537627749504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652221.578927:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627749504:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788652221.653071:0:9332:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00010000:00010000:0.0:1788652221.703929:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652222.730500:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652223.751982:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788652224.176446:0:9430:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00010000:00010000:0.0:1788652224.776686:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652225.170001:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788652225.170024:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627749632:0@lo:400:kworker.0 00000100:00100000:3.0:1788652225.170105:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652225.170184:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627749760:0@lo:400:kworker.0 00000100:00100000:3.0:1788652225.170211:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652225.170246:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627749760 00000100:00100000:3.0:1788652225.170253:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627749760 00000100:00100000:1.0:1788652225.170299:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627749632 00000100:00100000:3.0:1788652225.170304:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788652225.170306:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627749632 00000100:00100000:3.0:1788652225.170314:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627749760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652225.170349:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788652225.170359:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:3304:x1875537627749632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652225.170370:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a404e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627749760:12345-0@lo:400:kworker.0 Request processed in 56us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652225.170397:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788652225.170405:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:3304:x1875537627749632:12345-0@lo:400:kworker.0 Request processed in 48us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652225.170413:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788652225.170444:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627749760:0@lo:400:kworker.0 00000100:00100000:3.0:1788652225.170455:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627749632:0@lo:400:kworker.0 00000100:00100000:3.0:1788652225.170504:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788652225.170512:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875537627749888:0@lo:400:kworker.0 00000100:00100000:3.0:1788652225.170536:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652225.170585:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627750016:0@lo:400:kworker.0 00000100:00100000:3.0:1788652225.170624:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652225.170672:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627750016 00000100:00100000:3.0:1788652225.170675:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788652225.170678:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627750016 00000100:00100000:3.0:1788652225.170683:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875537627750144:0@lo:400:kworker.0 00000100:00100000:3.0:1788652225.170709:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652225.170723:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788652225.170731:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627750016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652225.170753:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627749888 00000100:00100000:3.0:1788652225.170758:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627749888 00000100:00100000:1.0:1788652225.170817:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627750016:12345-0@lo:400:kworker.0 Request processed in 86us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652225.170825:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788652225.170833:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627750144 00000100:00100000:3.0:1788652225.170837:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627750144 00010000:00080000:1.0:1788652225.170860:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a405500 x1875537627750016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652225.170863:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788652225.170875:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875537627749888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652225.170878:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a405500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627750016:0@lo:400:kworker.0 00000100:00100000:3.0:1788652225.170924:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875537627749888:12345-0@lo:400:kworker.0 Request processed in 51us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652225.170929:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788652225.170944:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788652225.170951:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875537627750144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652225.170954:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875537627749888:0@lo:400:kworker.0 00000100:00100000:3.0:1788652225.170987:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875537627750144:12345-0@lo:400:kworker.0 Request processed in 37us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652225.170993:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788652225.171003:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875537627750144:0@lo:400:kworker.0 00000100:00100000:1.0:1788652225.171081:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627750272:0@lo:400:kworker.0 00000100:00100000:1.0:1788652225.171108:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652225.171288:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627750272 00000100:00100000:3.0:1788652225.171292:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627750272 00000100:00100000:3.0:1788652225.171331:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788652225.171338:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627750272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652225.171385:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627750272:12345-0@lo:400:kworker.0 Request processed in 48us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652225.171391:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788652225.171423:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe75986680 x1875537627750272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652225.171442:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75986680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627750272:0@lo:400:kworker.0 00000100:00080000:0.0:1788652225.173388:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788652225.173401:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788652225.173404:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1788652225.601073:0:9479:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 19:50:23 EDT 2026 00000100:00100000:1.0:1788652225.671939:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627750400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788652225.672006:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652225.672205:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627750400 00000100:00100000:3.0:1788652225.672214:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627750400 00000100:00100000:3.0:1788652225.672266:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788652225.672275:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627750400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788652225.672308:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652225.672355:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627750400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652225.672361:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788652225.672411:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe75987100 x1875537627750400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652225.672430:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627750400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788652225.711938:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652225.712002:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652225.712063:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603600640 00000100:00100000:1.0:1788652225.712074:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603600640 00000100:00100000:2.0:1788652225.712096:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603600512 00000100:00100000:2.0:1788652225.712103:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603600512 00000100:00100000:1.0:1788652225.712162:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00100000:2.0:1788652225.712163:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 201 00000100:00100000:1.0:1788652225.712180:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2346:x1875537603600640:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652225.712181:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:2346:x1875537603600512:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652225.712256:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2346:x1875537603600640:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 81us (330us total) trans 0 rc 0/0 00000100:00080000:3.0:1788652225.712263:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788652225.712265:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00100000:2.0:1788652225.715136:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:2346:x1875537603600512:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 2947us (3118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652225.715151:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 201 00010000:00010000:2.0:1788652225.800043:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652226.697649:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627750528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788652226.697723:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652226.697816:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627750528 00000100:00100000:1.0:1788652226.697824:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627750528 00000100:00100000:1.0:1788652226.697872:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788652226.697882:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627750528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788652226.697916:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788652226.697963:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627750528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652226.697969:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788652226.698022:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a407800 x1875537627750528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652226.698039:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627750528:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788652226.826488:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.850426:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652228.876148:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652229.896160:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652230.281161:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd41fab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627751040:0@lo:400:kworker.0 00000100:00100000:1.0:1788652230.281161:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd41fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627750656:0@lo:400:kworker.0 00000100:00100000:1.0:1788652230.281264:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652230.281297:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd41fa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627750784:0@lo:400:kworker.0 00000100:00100000:0.0:1788652230.281336:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd41faa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627750912:0@lo:400:kworker.0 00000100:00100000:2.0:1788652230.289150:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652230.289458:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd41faad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875537627751168:0@lo:400:kworker.0 00000100:00100000:2.0:1788652230.289483:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627751040 00000100:00100000:2.0:1788652230.289495:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627751040 00000100:00100000:1.0:1788652230.289508:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652230.289569:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627750656 00000100:00100000:1.0:1788652230.289574:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627750656 00000100:00100000:2.0:1788652230.289587:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788652230.289602:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627751040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652230.289615:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788652230.289625:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+19:3303:x1875537627750656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652230.289683:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627751040:12345-0@lo:400:kworker.0 Request processed in 86us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652230.289686:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+19:3303:x1875537627750656:12345-0@lo:400:kworker.0 Request processed in 62us (8420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652230.289697:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788652230.289701:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00010000:00080000:2.0:1788652230.289759:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbd41fab100 x1875537627751040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652230.289765:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd41fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627750656:0@lo:400:kworker.0 00000100:00100000:1.0:1788652230.289880:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627751168 00000100:00100000:1.0:1788652230.289885:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627751168 00000100:00080000:3.0:1788652230.289906:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788652230.289913:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788652230.289922:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788652230.289931:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875537627751168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652230.290144:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875537627751168:12345-0@lo:400:kworker.0 Request processed in 214us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652230.290151:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788652230.290185:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd41faad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875537627751168:0@lo:400:kworker.0 00000100:00100000:3.0:1788652230.294311:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652230.294410:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd41fab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627751296:0@lo:400:kworker.0 00000100:00100000:3.0:1788652230.294508:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652230.294549:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627751296 00000100:00100000:3.0:1788652230.294559:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627751296 00000100:00100000:3.0:1788652230.294627:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788652230.294637:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75987800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627751296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652230.294694:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75987800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627751296:12345-0@lo:400:kworker.0 Request processed in 58us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652230.294703:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788652230.294726:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788652230.294757:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbd41fab800 x1875537627751296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652230.295913:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd41fab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627751296:0@lo:400:kworker.0 00000100:00100000:1.0:1788652230.296210:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652230.296447:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627750784 00000100:00100000:0.0:1788652230.296456:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627750784 00000100:00100000:0.0:1788652230.296628:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627750912 00000100:00100000:0.0:1788652230.296634:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627750912 00000100:00100000:1.0:1788652230.296837:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788652230.296843:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd41fab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627751040:0@lo:400:kworker.0 00000100:00100000:1.0:1788652230.296861:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627750784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652230.296966:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627750784:12345-0@lo:400:kworker.0 Request processed in 106us (2665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652230.296984:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788652230.297005:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788652230.297012:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627750912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652230.297066:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627750912:12345-0@lo:400:kworker.0 Request processed in 54us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652230.297073:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788652230.297119:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd41faa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627750912:0@lo:400:kworker.0 00000100:00080000:1.0:1788652230.297161:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652230.298254:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd41fa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627750784:0@lo:400:kworker.0 00000100:00100000:2.0:1788652230.794118:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788652230.794154:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75985500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627751424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788652230.794250:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652230.794594:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627751424 00000100:00100000:0.0:1788652230.794605:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627751424 00000100:00100000:0.0:1788652230.794675:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788652230.794687:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627751424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788652230.794734:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788652230.794820:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627751424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652230.794828:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788652230.794919:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe75985500 x1875537627751424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652230.794942:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75985500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627751424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788652230.833152:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652230.833231:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652230.833337:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603600768 00000100:00100000:0.0:1788652230.833352:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603600768 00000100:00100000:0.0:1788652230.833424:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 203 00000100:00100000:0.0:1788652230.833437:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:2347:x1875537603600768:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1788652230.833538:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:2347:x1875537603600768:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 103us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652230.833547:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 203 00000100:00100000:3.0:1788652230.835861:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603600896 00000100:00100000:3.0:1788652230.835880:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603600896 00000100:00100000:3.0:1788652230.836002:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 53 00000100:00100000:3.0:1788652230.836022:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2347:x1875537603600896:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1788652230.836129:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2347:x1875537603600896:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 117us (2896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652230.836136:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 53 00000100:00080000:0.0:1788652230.837313:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788652230.921564:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652231.816940:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788652231.816973:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd41fabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627751552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788652231.817562:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652231.817727:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627751552 00000100:00100000:0.0:1788652231.817739:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627751552 00000100:00100000:0.0:1788652231.817829:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788652231.817841:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41faa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627751552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788652231.817887:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788652231.817965:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41faa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627751552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652231.817972:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788652231.818038:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbd41fabb80 x1875537627751552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652247 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652231.818063:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd41fabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627751552:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788652231.945030:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652232.969971:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652233.992091:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652235.016882:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652235.401057:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627752064:0@lo:400:kworker.0 00000100:00100000:2.0:1788652235.401125:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627751680:0@lo:400:kworker.0 00000100:00100000:3.0:1788652235.401131:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652235.401178:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627752064 00000100:00100000:1.0:1788652235.401187:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627752064 00000100:00100000:0.0:1788652235.401194:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627751808:0@lo:400:kworker.0 00000100:00100000:1.0:1788652235.401247:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788652235.401255:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627752064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652235.401812:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652235.401858:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875537627752192:0@lo:400:kworker.0 00000100:00100000:2.0:1788652235.401885:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788652235.404765:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788652235.404894:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652235.406152:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75984a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627752320:0@lo:400:kworker.0 00000100:00100000:0.0:1788652235.406214:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652235.406277:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627751936:0@lo:400:kworker.0 00000100:00100000:2.0:1788652235.406283:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627752192 00000100:00100000:2.0:1788652235.406292:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627752192 00000100:00100000:0.0:1788652235.406309:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652235.406352:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627751808 00000100:00100000:2.0:1788652235.406354:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627751936 00000100:00100000:0.0:1788652235.406357:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627751808 00000100:00100000:2.0:1788652235.406359:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627751936 00000100:00100000:0.0:1788652235.406395:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788652235.406405:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875537627752192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652235.406459:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627752320 00000100:00100000:3.0:1788652235.406464:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627752320 00000100:00100000:0.0:1788652235.406469:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875537627752192:12345-0@lo:400:kworker.0 Request processed in 64us (4580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652235.406495:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788652235.406516:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627752320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652235.406568:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627752320:12345-0@lo:400:kworker.0 Request processed in 53us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652235.406575:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788652235.407248:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788652235.407260:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627751808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652235.407295:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627751808:12345-0@lo:400:kworker.0 Request processed in 40us (2405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652235.407301:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788652235.407317:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788652235.407322:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627751936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652235.407349:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627751936:12345-0@lo:400:kworker.0 Request processed in 28us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652235.407355:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788652235.407370:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788652235.407375:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788652235.408703:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627752064:12345-0@lo:400:kworker.0 Request processed in 7393us (7520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652235.408716:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788652235.408751:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627751680 00000100:00100000:1.0:1788652235.408757:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627751680 00010000:00080000:2.0:1788652235.408759:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe75985180 x1875537627752064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652235.408805:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788652235.408809:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627752064:0@lo:400:kworker.0 00000100:00100000:1.0:1788652235.408813:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:3303:x1875537627751680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652235.408853:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:3303:x1875537627751680:12345-0@lo:400:kworker.0 Request processed in 41us (7051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652235.408859:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788652235.408929:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627751680:0@lo:400:kworker.0 00000100:00100000:1.0:1788652235.408960:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875537627752192:0@lo:400:kworker.0 00000100:00100000:1.0:1788652235.409011:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627751936:0@lo:400:kworker.0 00000100:00100000:0.0:1788652235.410760:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788652235.410883:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627751808:0@lo:400:kworker.0 00010000:00080000:3.0:1788652235.411324:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe75984a80 x1875537627752320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652235.411337:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75984a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627752320:0@lo:400:kworker.0 00000100:00100000:0.0:1788652235.912223:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627752448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788652235.912292:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652235.912360:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627752448 00000100:00100000:0.0:1788652235.912368:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627752448 00000100:00100000:0.0:1788652235.912412:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788652235.912422:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627752448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788652235.912472:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788652235.912518:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627752448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652235.912526:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788652235.912584:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe819e4380 x1875537627752448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652235.912602:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627752448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788652235.951909:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652235.951958:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652235.952019:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603601152 00000100:00100000:3.0:1788652235.952020:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603601024 00000100:00100000:3.0:1788652235.952030:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603601024 00000100:00100000:1.0:1788652235.952031:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603601152 00000100:00100000:3.0:1788652235.952086:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 205 00000100:00100000:1.0:1788652235.952099:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00100000:3.0:1788652235.952101:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:2348:x1875537603601024:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652235.952111:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41faad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2349:x1875537603601152:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652235.952165:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41faad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2349:x1875537603601152:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 58us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652235.952172:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00080000:2.0:1788652235.952308:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652235.953362:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:2348:x1875537603601024:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 1261us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652235.953373:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 205 00010000:00010000:2.0:1788652236.041867:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652236.937587:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd41fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627752576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788652236.937655:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652236.937728:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627752576 00000100:00100000:2.0:1788652236.937735:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627752576 00000100:00100000:2.0:1788652236.937802:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788652236.938693:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41faa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627752576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788652236.938730:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788652236.939507:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41faa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627752576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 818us (1848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652236.939517:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788652236.939892:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbd41fa8000 x1875537627752576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652252 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652236.939915:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd41fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627752576:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788652237.063985:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652238.091116:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652239.111999:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788652240.001609:0:10109:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 19:50:37 (1788652237) === 00010000:00010000:0.0:1788652240.135910:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652240.416023:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652240.416256:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603601280 00000100:00100000:0.0:1788652240.416270:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603601280 00000100:00100000:0.0:1788652240.416352:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 206 00000100:00100000:0.0:1788652240.416364:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:8116:x1875537603601280:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788652240.416385:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652240.416409:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe49e56000/0x340ed74ef02a75f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f07b0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652240.416446:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe49e56000/0x340ed74ef02a75f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07b0 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652240.416459:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe49e56000/0x340ed74ef02a75f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07b0 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652240.416487:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e56000, rc 0) 00000100:00100000:0.0:1788652240.416561:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+11:8116:x1875537603601280:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 199us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652240.416570:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 206 00000100:00100000:1.0:1788652240.425692:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652240.425947:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603601408 00000100:00100000:3.0:1788652240.425970:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603601408 00000100:00100000:3.0:1788652240.426100:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 207 00000100:00100000:3.0:1788652240.426113:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+11:8116:x1875537603601408:12345-192.168.203.50@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788652240.426538:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+11:8116:x1875537603601408:12345-192.168.203.50@tcp:501:mount.lustre.0 Request processed in 425us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652240.426547:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 207 00000100:00100000:1.0:1788652240.430248:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652240.430753:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603601536 00000100:00100000:2.0:1788652240.430871:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603601536 00000100:00100000:2.0:1788652240.430962:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 208 00000100:00100000:2.0:1788652240.430975:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+11:8116:x1875537603601536:12345-192.168.203.50@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788652240.431874:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+11:8116:x1875537603601536:12345-192.168.203.50@tcp:503:mount.lustre.0 Request processed in 894us (1630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652240.431887:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 208 00000100:00100000:2.0:1788652240.445085:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652240.445187:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603601664 00000100:00100000:3.0:1788652240.445201:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603601664 00000100:00100000:3.0:1788652240.445281:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 209 00000100:00100000:3.0:1788652240.445293:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+11:8120:x1875537603601664:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788652240.446695:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+11:8120:x1875537603601664:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 1394us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652240.446723:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 209 00000100:00100000:1.0:1788652240.465901:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652240.466139:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603601792 00000100:00100000:2.0:1788652240.466153:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603601792 00000100:00100000:2.0:1788652240.466217:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 210 00000100:00100000:2.0:1788652240.466229:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+11:8120:x1875537603601792:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788652240.466601:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+11:8120:x1875537603601792:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 372us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652240.466619:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 210 00000100:00100000:1.0:1788652240.473469:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652240.473730:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603601920 00000100:00100000:3.0:1788652240.473747:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603601920 00000100:00100000:3.0:1788652240.473865:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 211 00000100:00100000:3.0:1788652240.473877:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+11:8116:x1875537603601920:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788652240.473899:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652240.473925:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7a0e5600/0x340ed74ef02a7600 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f07da expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652240.473973:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7a0e5600/0x340ed74ef02a7600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07da expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652240.473987:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7a0e5600/0x340ed74ef02a7600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07da expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652240.473999:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5600, rc 0) 00000100:00100000:3.0:1788652240.474075:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+12:8116:x1875537603601920:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 200us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652240.474083:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 211 00000100:00100000:3.0:1788652240.479716:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652240.480230:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603602048 00000100:00100000:0.0:1788652240.480244:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603602048 00000100:00100000:0.0:1788652240.480347:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 212 00000100:00100000:0.0:1788652240.480359:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+12:8116:x1875537603602048:12345-192.168.203.50@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788652240.480396:0:5828:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788652240.480428:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788652240.480433:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788652240.480436:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788652240.480438:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788652240.483237:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+12:8116:x1875537603602048:12345-192.168.203.50@tcp:256:mount.lustre.0 Request processed in 2358us (3020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652240.483259:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 212 00000100:00100000:1.0:1788652240.486682:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652240.487011:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603602176 00000100:00100000:2.0:1788652240.487024:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603602176 00000100:00100000:2.0:1788652240.487134:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 213 00000100:00100000:2.0:1788652240.487147:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+12:8116:x1875537603602176:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788652240.487169:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652240.487192:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe8215e000/0x340ed74ef02a7607 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f07e1 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652240.487230:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe8215e000/0x340ed74ef02a7607 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07e1 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652240.487244:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe8215e000/0x340ed74ef02a7607 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07e1 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652240.487255:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215e000, rc 0) 00000100:00100000:2.0:1788652240.487331:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:8116:x1875537603602176:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 187us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652240.487338:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 213 00000100:00100000:3.0:1788652240.489506:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652240.489694:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603602304 00000100:00100000:0.0:1788652240.489717:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603602304 00000100:00100000:0.0:1788652240.489965:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 214 00000100:00100000:0.0:1788652240.489978:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:8116:x1875537603602304:12345-192.168.203.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788652240.490445:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:8116:x1875537603602304:12345-192.168.203.50@tcp:501:mount.lustre.0 Request processed in 466us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652240.490455:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 214 00000100:00100000:1.0:1788652240.493098:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652240.493195:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603602432 00000100:00100000:3.0:1788652240.493207:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603602432 00000100:00100000:3.0:1788652240.493309:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 215 00000100:00100000:3.0:1788652240.493321:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:8116:x1875537603602432:12345-192.168.203.50@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788652240.493640:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:8116:x1875537603602432:12345-192.168.203.50@tcp:503:mount.lustre.0 Request processed in 319us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652240.493649:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 215 00000100:00100000:1.0:1788652240.497209:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652240.497338:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603602560 00000100:00100000:2.0:1788652240.497353:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603602560 00000100:00100000:2.0:1788652240.497459:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 216 00000100:00100000:2.0:1788652240.497472:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:8124:x1875537603602560:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788652240.498051:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:8124:x1875537603602560:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 579us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652240.498061:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 216 00000100:00100000:3.0:1788652240.504380:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652240.504666:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603602688 00000100:00100000:0.0:1788652240.504679:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603602688 00000100:00100000:0.0:1788652240.504967:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 217 00000100:00100000:0.0:1788652240.504980:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:8124:x1875537603602688:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788652240.505313:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:8124:x1875537603602688:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 333us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652240.505324:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 217 00000100:00100000:1.0:1788652240.509483:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652240.509643:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603602816 00000100:00100000:3.0:1788652240.509657:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603602816 00000100:00100000:3.0:1788652240.509720:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:3.0:1788652240.509741:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2345:x1875537603602816:12345-192.168.203.50@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788652240.509812:0:6701:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3eb94160-5684-49f0-9e45-fbf338e18f8d@192.168.203.50@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:3.0:1788652240.509865:0:6701:0:(genops.c:1385:class_connect()) connect: client 3eb94160-5684-49f0-9e45-fbf338e18f8d, cookie 0x340ed74ef02a760e 00000004:00100000:3.0:1788652240.509907:0:6701:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788652240.510277:0:6701:0:(import.c:65:import_set_state_nolock()) ffff8cbe7f385000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788652240.510375:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eb94160-5684-49f0-9e45-fbf338e18f8d+6:2345:x1875537603602816:12345-192.168.203.50@tcp:38:mount.lustre.0 Request processed in 645us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652240.510385:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:3.0:1788652240.515692:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652240.515869:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603603200 00000100:00100000:1.0:1788652240.515884:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603603200 00000100:00100000:1.0:1788652240.515997:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 58 00000100:00100000:1.0:1788652240.516011:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2347:x1875537603603200:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652240.516119:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2347:x1875537603603200:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 111us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652240.516126:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 58 00000100:00080000:2.0:1788652240.516391:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652240.519413:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652240.519465:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652240.519576:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603603072 00000100:00100000:3.0:1788652240.519593:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603603072 00000100:00100000:3.0:1788652240.519858:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603602944 00000100:00100000:3.0:1788652240.519862:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603602944 00000100:00080000:2.0:1788652240.519934:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788652240.520042:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:2.0:1788652240.520115:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627752960:0@lo:400:kworker.0 00000100:00100000:2.0:1788652240.520163:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652240.520216:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788652240.520222:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627753088:0@lo:400:kworker.0 00000100:00100000:2.0:1788652240.520248:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652240.520286:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627752960 00000100:00100000:2.0:1788652240.520293:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627752960 00000100:00100000:1.0:1788652240.520489:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3eb94160-5684-49f0-9e45-fbf338e18f8d+7:8116:x1875537603603072:12345-192.168.203.50@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788652240.520617:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788652240.521368:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3eb94160-5684-49f0-9e45-fbf338e18f8d+7:8116:x1875537603603072:12345-192.168.203.50@tcp:41:mount.lustre.0 Request processed in 882us (1962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652240.523089:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:2.0:1788652240.523110:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788652240.523135:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627752960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652240.523145:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:1.0:1788652240.523163:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3eb94160-5684-49f0-9e45-fbf338e18f8d+6:0:x1875537603602944:12345-192.168.203.50@tcp:41:mount.lustre.0 00000100:00100000:2.0:1788652240.523238:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627752960:12345-0@lo:400:kworker.0 Request processed in 116us (3072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652240.523247:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000004:00000024:1.0:1788652240.523263:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788652240.523295:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627753088 00000100:00100000:2.0:1788652240.523305:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627753088 00000100:00100000:2.0:1788652240.523352:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788652240.523360:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627753088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652240.523400:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627753088:12345-0@lo:400:kworker.0 Request processed in 41us (3151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652240.523927:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3eb94160-5684-49f0-9e45-fbf338e18f8d+6:0:x1875537603602944:12345-192.168.203.50@tcp:41:mount.lustre.0 Request processed in 768us (4457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652240.523936:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:1.0:1788652240.523988:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627752704:0@lo:400:kworker.0 00000100:00100000:2.0:1788652240.524012:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788652240.524047:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788652240.524052:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788652240.524069:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652240.524132:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875537627753216:0@lo:400:kworker.0 00000100:00100000:0.0:1788652240.524155:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627752704 00000100:00100000:0.0:1788652240.524163:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627752704 00000100:00100000:1.0:1788652240.524171:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652240.524208:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788652240.524217:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+19:3303:x1875537627752704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652240.524268:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+19:3303:x1875537627752704:12345-0@lo:400:kworker.0 Request processed in 51us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652240.524276:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788652240.524312:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627752704:0@lo:400:kworker.0 00010000:00080000:2.0:1788652240.524324:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe493ba300 x1875537627753088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652240.524331:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788652240.524348:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627752832:0@lo:400:kworker.0 00000100:00100000:2.0:1788652240.524350:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627753088:0@lo:400:kworker.0 00000100:00100000:3.0:1788652240.524464:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627753216 00000100:00100000:3.0:1788652240.524471:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627753216 00000100:00100000:3.0:1788652240.524525:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788652240.524546:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875537627753216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652240.525328:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652240.525354:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627753344:0@lo:400:kworker.0 00000100:00100000:1.0:1788652240.525669:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652240.525761:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627753344 00000100:00100000:0.0:1788652240.525793:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627753344 00000100:00100000:0.0:1788652240.525847:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788652240.525856:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627753344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652240.525920:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627753344:12345-0@lo:400:kworker.0 Request processed in 65us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652240.525929:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788652240.526000:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe493b8380 x1875537627753344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652240.526032:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627753344:0@lo:400:kworker.0 00000100:00100000:1.0:1788652240.526065:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627752832 00000100:00100000:1.0:1788652240.526070:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627752832 00000100:00100000:1.0:1788652240.526103:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788652240.526112:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627752832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652240.526176:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627752832:12345-0@lo:400:kworker.0 Request processed in 64us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652240.526306:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788652240.526378:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627752832:0@lo:400:kworker.0 00000100:00100000:2.0:1788652240.527927:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627752960:0@lo:400:kworker.0 00000100:00100000:3.0:1788652240.528043:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875537627753216:12345-0@lo:400:kworker.0 Request processed in 3488us (3867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652240.528061:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788652240.528088:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875537627753216:0@lo:400:kworker.0 00000100:00080000:3.0:1788652240.528121:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788652240.528130:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788652240.529094:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652240.529202:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603603328 00000100:00100000:1.0:1788652240.529213:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603603328 00000100:00100000:1.0:1788652240.529519:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:1.0:1788652240.529532:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3eb94160-5684-49f0-9e45-fbf338e18f8d+6:8116:x1875537603603328:12345-192.168.203.50@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788652240.529638:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3eb94160-5684-49f0-9e45-fbf338e18f8d+6:8116:x1875537603603328:12345-192.168.203.50@tcp:40:mount.lustre.0 Request processed in 109us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652240.529646:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:1.0:1788652240.538417:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652240.538464:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652240.538499:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652240.538598:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603603712 00000100:00100000:3.0:1788652240.538614:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603603712 00000100:00100000:0.0:1788652240.538676:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603603456 00000100:00100000:0.0:1788652240.538682:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603603456 00000100:00100000:3.0:1788652240.538691:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 1 00000100:00100000:3.0:1788652240.538703:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3eb94160-5684-49f0-9e45-fbf338e18f8d+6:8116:x1875537603603712:12345-192.168.203.50@tcp:33:mount.lustre.0 00000100:00100000:0.0:1788652240.538705:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603603584 00000100:00100000:0.0:1788652240.538708:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603603584 00000100:00100000:0.0:1788652240.538744:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:0.0:1788652240.538750:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1875537603603456:12345-192.168.203.50@tcp:8:mount.lustre.0 00000004:00200000:3.0:1788652240.538834:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1788652240.538886:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3eb94160-5684-49f0-9e45-fbf338e18f8d@192.168.203.50@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:0.0:1788652240.538923:0:6680:0:(genops.c:1385:class_connect()) connect: client 3eb94160-5684-49f0-9e45-fbf338e18f8d, cookie 0x340ed74ef02a7615 00002000:00100000:0.0:1788652240.538937:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3eb94160-5684-49f0-9e45-fbf338e18f8d/ffff8cbe81d18000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1788652240.538938:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3eb94160-5684-49f0-9e45-fbf338e18f8d+6:8116:x1875537603603712:12345-192.168.203.50@tcp:33:mount.lustre.0 Request processed in 237us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652240.538945:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 1 00002000:00100000:0.0:1788652240.538979:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788652240.539358:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788652240.539397:0:6680:0:(import.c:65:import_set_state_nolock()) ffff8cbe81d1d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788652240.539433:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3eb94160-5684-49f0-9e45-fbf338e18f8d+6:2345:x1875537603603456:12345-192.168.203.50@tcp:8:mount.lustre.0 Request processed in 683us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652240.539441:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:0.0:1788652240.539459:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:0.0:1788652240.539464:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1875537603603584:12345-192.168.203.50@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788652240.539482:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3eb94160-5684-49f0-9e45-fbf338e18f8d@192.168.203.50@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:0.0:1788652240.539500:0:6680:0:(genops.c:1385:class_connect()) connect: client 3eb94160-5684-49f0-9e45-fbf338e18f8d, cookie 0x340ed74ef02a761c 00002000:00100000:0.0:1788652240.539585:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3eb94160-5684-49f0-9e45-fbf338e18f8d/ffff8cbe81d1b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788652240.539603:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788652240.539748:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788652240.539767:0:6680:0:(import.c:65:import_set_state_nolock()) ffff8cbe81d1e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788652240.539926:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3eb94160-5684-49f0-9e45-fbf338e18f8d+6:2345:x1875537603603584:12345-192.168.203.50@tcp:8:mount.lustre.0 Request processed in 459us (1425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652240.539935:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:3.0:1788652241.034676:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627753472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788652241.034748:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652241.034891:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627753472 00000100:00100000:2.0:1788652241.034899:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627753472 00000100:00100000:2.0:1788652241.034954:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788652241.034964:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627753472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788652241.034986:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788652241.035037:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627753472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652241.035043:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788652241.035308:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7f2c1c00 x1875537627753472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652257 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652241.035328:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627753472:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788652241.162204:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652242.060294:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627753600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788652242.060363:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652242.060462:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627753600 00000100:00100000:2.0:1788652242.060469:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627753600 00000100:00100000:2.0:1788652242.060526:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788652242.060535:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627753600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788652242.060566:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788652242.060610:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627753600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652242.060616:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788652242.060654:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe493b8a80 x1875537627753600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652242.060672:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627753600:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788652242.060937:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1788652242.128545:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3eb94160-5684-49f0-9e45-fbf338e18f8d 00010000:00010000:1.0:1788652242.183998:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652243.208879:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652244.237410:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788652245.015844:0:10303:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:2.0:1788652245.164964:0:5857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3eb94160-5684-49f0-9e45-fbf338e18f8d 00000001:00100000:3.0:1788652245.183609:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3eb94160-5684-49f0-9e45-fbf338e18f8d 00010000:00010000:3.0:1788652245.255943:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652245.640186:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627753728:0@lo:400:kworker.0 00000100:00100000:3.0:1788652245.640270:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627753856:0@lo:400:kworker.0 00000100:00100000:2.0:1788652245.640282:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652245.640356:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875537627754240:0@lo:400:kworker.0 00000100:00100000:3.0:1788652245.640368:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652245.640416:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652245.640419:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627754112:0@lo:400:kworker.0 00000100:00100000:3.0:1788652245.640435:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627754368:0@lo:400:kworker.0 00000100:00100000:2.0:1788652245.640469:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627753856 00000100:00100000:2.0:1788652245.640478:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627753856 00000100:00100000:2.0:1788652245.640530:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627754240 00000100:00100000:2.0:1788652245.640535:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627754240 00000100:00100000:2.0:1788652245.640566:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788652245.640574:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627753856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652245.640630:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788652245.640639:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627753856:12345-0@lo:400:kworker.0 Request processed in 63us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652245.640649:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875537627754240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652245.640650:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788652245.640684:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652245.640732:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875537627754240:12345-0@lo:400:kworker.0 Request processed in 89us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652245.640742:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788652245.640810:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875537627754240:0@lo:400:kworker.0 00000100:00100000:0.0:1788652245.641118:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652245.641161:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788652245.641170:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875537627753984:0@lo:400:kworker.0 00000100:00100000:0.0:1788652245.641200:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652245.641230:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627753984 00000100:00100000:0.0:1788652245.641235:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627753984 00000100:00100000:3.0:1788652245.641259:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652245.641274:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788652245.641286:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875537627753984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652245.641329:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627753856:0@lo:400:kworker.0 00000100:00100000:0.0:1788652245.641344:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875537627753984:12345-0@lo:400:kworker.0 Request processed in 58us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652245.641354:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788652245.641378:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627754112 00000100:00100000:3.0:1788652245.641386:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627754112 00000100:00100000:3.0:1788652245.641431:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627754368 00000100:00100000:3.0:1788652245.641435:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627754368 00000100:00100000:3.0:1788652245.641458:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788652245.641466:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627754112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652245.641524:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627754112:12345-0@lo:400:kworker.0 Request processed in 58us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652245.641532:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788652245.641545:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788652245.641551:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627754368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652245.641582:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627754368:12345-0@lo:400:kworker.0 Request processed in 31us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652245.641588:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788652245.641636:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7f2c1c00 x1875537627754368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652245.641664:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627754368:0@lo:400:kworker.0 00000100:00100000:1.0:1788652245.641813:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627753728 00000100:00100000:1.0:1788652245.641821:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627753728 00000100:00100000:1.0:1788652245.641861:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788652245.641869:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:3303:x1875537627753728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652245.641933:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:3303:x1875537627753728:12345-0@lo:400:kworker.0 Request processed in 65us (1653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652245.641949:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:2.0:1788652245.642234:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788652245.642240:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788652245.642243:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652245.642268:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627753728:0@lo:400:kworker.0 00000100:00100000:0.0:1788652245.642793:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875537627753984:0@lo:400:kworker.0 00010000:00080000:0.0:1788652245.642818:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7f2c2300 x1875537627754112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652245.642829:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627754112:0@lo:400:kworker.0 00000100:00100000:0.0:1788652245.684558:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652245.684666:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652245.684711:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652245.684731:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652245.684980:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652245.685062:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603604224 00000100:00100000:2.0:1788652245.685072:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603604224 00000100:00100000:3.0:1788652245.685124:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603603968 00000100:00100000:2.0:1788652245.685128:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603604352 00000100:00100000:3.0:1788652245.685129:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603603968 00000100:00100000:2.0:1788652245.685130:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603604352 00000100:00100000:2.0:1788652245.685152:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 38 00000100:00100000:3.0:1788652245.685156:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603604096 00000100:00100000:3.0:1788652245.685159:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603604096 00000100:00100000:2.0:1788652245.685161:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2348:x1875537603604224:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1788652245.685177:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 65 00000100:00100000:3.0:1788652245.685184:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2348:x1875537603603968:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1788652245.685280:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2348:x1875537603603968:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 96us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652245.685287:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 65 00000100:00100000:3.0:1788652245.685304:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 66 00000100:00100000:3.0:1788652245.685311:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2348:x1875537603604096:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652245.685363:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603603840 00000100:00100000:1.0:1788652245.685379:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603603840 00000100:00100000:1.0:1788652245.685454:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 220 00000100:00100000:1.0:1788652245.686623:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2348:x1875537603603840:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652245.689173:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2348:x1875537603604224:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 3998us (4492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652245.689189:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 38 00000100:00100000:2.0:1788652245.689235:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 39 00000100:00100000:2.0:1788652245.689248:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2348:x1875537603604352:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652245.689299:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2348:x1875537603604352:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 56us (4319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652245.689305:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 39 00000100:00080000:2.0:1788652245.689333:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788652245.689339:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788652245.689341:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788652245.692237:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2348:x1875537603604096:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 6913us (7491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652245.692254:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 66 00000100:00100000:1.0:1788652245.692270:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2348:x1875537603603840:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 6793us (7544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652245.692287:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 220 00000100:00100000:0.0:1788652246.151988:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627754496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788652246.152058:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652246.152168:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627754496 00000100:00100000:3.0:1788652246.152176:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627754496 00000100:00100000:3.0:1788652246.152230:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788652246.152240:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627754496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788652246.152276:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652246.152336:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627754496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652246.152342:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788652246.152383:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe75987480 x1875537627754496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652246.152415:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627754496:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788652246.280017:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652247.176875:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788652247.176898:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627754624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788652247.176972:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652247.177035:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627754624 00000100:00100000:2.0:1788652247.177042:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627754624 00000100:00100000:2.0:1788652247.177090:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788652247.177099:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627754624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788652247.177131:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788652247.177278:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627754624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 180us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652247.177285:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788652247.177462:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788652247.177502:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe493b8000 x1875537627754624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652247.177697:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627754624:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788652247.308046:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652248.329419:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652249.352034:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652250.376931:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652250.770065:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627755008:0@lo:400:kworker.0 00000100:00100000:0.0:1788652250.770136:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652250.770193:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788652250.770199:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627755136:0@lo:400:kworker.0 00000100:00100000:0.0:1788652250.770223:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652250.770261:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627755008 00000100:00100000:0.0:1788652250.770268:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627755008 00000100:00100000:0.0:1788652250.770326:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788652250.770336:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627755008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652250.770389:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627755008:12345-0@lo:400:kworker.0 Request processed in 54us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652250.770396:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1788652250.770419:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788652250.770480:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627755008:0@lo:400:kworker.0 00000100:00100000:2.0:1788652250.770540:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627754752:0@lo:400:kworker.0 00000100:00100000:2.0:1788652250.770576:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652250.770610:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875537627755264:0@lo:400:kworker.0 00000100:00100000:2.0:1788652250.770631:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652250.770650:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788652250.770657:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627754880:0@lo:400:kworker.0 00000100:00100000:2.0:1788652250.770677:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652250.770692:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627755392:0@lo:400:kworker.0 00000100:00100000:2.0:1788652250.770710:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652250.770734:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627755136 00000100:00100000:2.0:1788652250.770738:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627755136 00000100:00100000:2.0:1788652250.770768:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627755392 00000100:00100000:2.0:1788652250.770798:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627755392 00000100:00100000:2.0:1788652250.770820:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788652250.770827:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627755136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652250.770860:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627755136:12345-0@lo:400:kworker.0 Request processed in 35us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652250.770866:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788652250.770896:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788652250.770903:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627755392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652250.770935:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627755392:12345-0@lo:400:kworker.0 Request processed in 33us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652250.770941:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788652250.770959:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627755264 00000100:00100000:2.0:1788652250.770962:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627755264 00000100:00100000:2.0:1788652250.770980:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627754880 00000100:00100000:2.0:1788652250.770993:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627754880 00000100:00100000:2.0:1788652250.771011:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788652250.771017:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875537627755264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652250.771049:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875537627755264:12345-0@lo:400:kworker.0 Request processed in 32us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652250.771055:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788652250.771066:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788652250.771071:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627754880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652250.771098:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627754880:12345-0@lo:400:kworker.0 Request processed in 27us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652250.771104:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788652250.771144:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627754880:0@lo:400:kworker.0 00010000:00080000:2.0:1788652250.771157:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7f2fa300 x1875537627755392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652250.771167:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627755392:0@lo:400:kworker.0 00000100:00100000:2.0:1788652250.771176:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875537627755264:0@lo:400:kworker.0 00000100:00100000:0.0:1788652250.771282:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627754752 00000100:00100000:0.0:1788652250.771286:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627754752 00000100:00100000:0.0:1788652250.771323:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788652250.771331:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+19:3303:x1875537627754752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652250.771369:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+19:3303:x1875537627754752:12345-0@lo:400:kworker.0 Request processed in 40us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652250.771376:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788652250.771407:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627754752:0@lo:400:kworker.0 00000100:00080000:0.0:1788652250.771423:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788652250.771432:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788652250.771435:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788652250.771455:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7f2f9c00 x1875537627755136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652250.771464:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627755136:0@lo:400:kworker.0 00000100:00100000:0.0:1788652250.805629:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652250.805937:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652250.805963:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652250.806028:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652250.806051:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652250.806104:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603604736 00000100:00100000:2.0:1788652250.806113:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603604736 00000100:00100000:2.0:1788652250.806171:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603604608 00000100:00100000:2.0:1788652250.806174:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603604608 00000100:00100000:2.0:1788652250.806196:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 70 00000100:00100000:2.0:1788652250.806206:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2346:x1875537603604736:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652250.806282:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2346:x1875537603604736:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 76us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652250.806290:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 70 00000100:00100000:2.0:1788652250.806326:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 71 00000100:00100000:2.0:1788652250.806333:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2346:x1875537603604608:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652250.806360:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2346:x1875537603604608:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 28us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652250.806367:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 71 00000100:00080000:2.0:1788652250.806487:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788652250.806554:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603604480 00000100:00100000:1.0:1788652250.806558:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603604480 00000100:00100000:1.0:1788652250.806592:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 222 00000100:00100000:1.0:1788652250.806599:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2346:x1875537603604480:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652250.806630:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2346:x1875537603604480:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 32us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652250.806636:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 222 00000100:00100000:3.0:1788652250.809206:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603604992 00000100:00100000:3.0:1788652250.809235:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603604992 00000100:00100000:2.0:1788652250.809274:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603604864 00000100:00100000:2.0:1788652250.809278:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603604864 00000100:00100000:2.0:1788652250.809389:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 42 00000100:00100000:2.0:1788652250.809400:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2346:x1875537603604864:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652250.809479:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2346:x1875537603604864:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 81us (3426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652250.809487:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 42 00000100:00080000:0.0:1788652250.810128:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788652250.810134:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788652250.810259:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 43 00000100:00100000:2.0:1788652250.810268:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe742b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2346:x1875537603604992:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652250.810308:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe742b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2346:x1875537603604992:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 42us (4345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652250.810315:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 43 00000100:00100000:3.0:1788652251.272371:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788652251.272393:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627755520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788652251.272461:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652251.272802:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627755520 00000100:00100000:2.0:1788652251.272811:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627755520 00000100:00100000:2.0:1788652251.272862:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788652251.272871:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75987800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627755520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788652251.272920:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788652251.272974:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75987800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627755520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652251.273000:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1788652251.273546:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe75984e00 x1875537627755520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652251.273568:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627755520:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788652251.402474:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652252.296116:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627755648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788652252.296188:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652252.298484:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627755648 00000100:00100000:1.0:1788652252.298501:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627755648 00000100:00100000:1.0:1788652252.298560:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788652252.298570:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627755648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788652252.298605:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788652252.298797:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788652252.299259:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627755648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 689us (3068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652252.299268:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1788652252.299883:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe493b8e00 x1875537627755648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652252.300479:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627755648:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788652252.423997:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652253.450121:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652254.472949:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652255.496036:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652255.880118:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627756160:0@lo:400:kworker.0 00000100:00100000:3.0:1788652255.880186:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652255.880251:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788652255.880257:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875537627756032:0@lo:400:kworker.0 00000100:00100000:3.0:1788652255.880283:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652255.880318:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627756160 00000100:00100000:3.0:1788652255.880325:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627756160 00000100:00100000:3.0:1788652255.880380:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788652255.880389:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627756160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652255.880449:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627756160:12345-0@lo:400:kworker.0 Request processed in 61us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652255.880456:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788652255.880479:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627756032 00000100:00100000:3.0:1788652255.880482:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627756032 00000100:00100000:3.0:1788652255.880510:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788652255.880517:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875537627756032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652255.880547:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875537627756032:12345-0@lo:400:kworker.0 Request processed in 32us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652255.880570:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1788652255.880586:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788652255.880590:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788652255.880622:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875537627756032:0@lo:400:kworker.0 00010000:00080000:3.0:1788652255.880633:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe75985880 x1875537627756160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652255.880642:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627756160:0@lo:400:kworker.0 00000100:00100000:0.0:1788652255.880836:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627755776:0@lo:400:kworker.0 00000100:00100000:0.0:1788652255.880879:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652255.880912:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875537627756288:0@lo:400:kworker.0 00000100:00100000:0.0:1788652255.880934:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652255.880957:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788652255.880964:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627755904:0@lo:400:kworker.0 00000100:00100000:0.0:1788652255.880984:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652255.881002:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627756416:0@lo:400:kworker.0 00000100:00100000:0.0:1788652255.881022:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652255.881045:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627756288 00000100:00100000:0.0:1788652255.881049:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627756288 00000100:00100000:0.0:1788652255.881082:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627755904 00000100:00100000:0.0:1788652255.881085:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627755904 00000100:00100000:0.0:1788652255.881099:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788652255.881105:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875537627756288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652255.881139:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875537627756288:12345-0@lo:400:kworker.0 Request processed in 34us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652255.881145:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788652255.881157:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788652255.881162:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627755904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652255.881186:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627755904:12345-0@lo:400:kworker.0 Request processed in 24us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652255.881192:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788652255.881216:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75984380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627755904:0@lo:400:kworker.0 00000100:00100000:0.0:1788652255.881225:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875537627756288:0@lo:400:kworker.0 00000100:00100000:2.0:1788652255.881287:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627755776 00000100:00100000:2.0:1788652255.881291:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627755776 00000100:00100000:2.0:1788652255.881327:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788652255.881334:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:3303:x1875537627755776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652255.881369:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:3303:x1875537627755776:12345-0@lo:400:kworker.0 Request processed in 36us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652255.881375:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788652255.881505:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627755776:0@lo:400:kworker.0 00000100:00100000:3.0:1788652255.881569:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627756416 00000100:00100000:3.0:1788652255.881573:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627756416 00000100:00100000:3.0:1788652255.881605:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788652255.881612:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627756416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652255.881655:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627756416:12345-0@lo:400:kworker.0 Request processed in 44us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652255.881661:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788652255.881678:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788652255.881681:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788652255.881809:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe75987b80 x1875537627756416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652255.881819:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627756416:0@lo:400:kworker.0 00000100:00100000:1.0:1788652255.922836:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652255.922884:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652255.922911:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652255.922928:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652255.922961:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652255.923150:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603605248 00000100:00100000:0.0:1788652255.923160:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603605248 00000100:00100000:0.0:1788652255.923224:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603605376 00000100:00100000:0.0:1788652255.923227:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603605376 00000100:00100000:0.0:1788652255.923244:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 75 00000100:00100000:0.0:1788652255.923253:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2346:x1875537603605248:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1788652255.923328:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2346:x1875537603605248:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 75us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652255.923342:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 75 00000100:00100000:0.0:1788652255.923358:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 76 00000100:00100000:0.0:1788652255.923365:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2347:x1875537603605376:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1788652255.923391:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2347:x1875537603605376:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 28us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652255.923397:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 76 00000100:00100000:3.0:1788652255.923481:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603605120 00000100:00100000:3.0:1788652255.923486:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603605120 00000100:00100000:3.0:1788652255.923511:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 224 00000100:00100000:3.0:1788652255.923518:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2347:x1875537603605120:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1788652255.923543:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2347:x1875537603605120:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 26us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652255.923549:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 224 00000100:00100000:3.0:1788652255.923574:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603605504 00000100:00100000:3.0:1788652255.923577:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603605504 00000100:00100000:3.0:1788652255.923610:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603605632 00000100:00100000:3.0:1788652255.923613:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603605632 00000100:00100000:3.0:1788652255.923632:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 46 00000100:00100000:3.0:1788652255.923638:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2346:x1875537603605504:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1788652255.923678:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2346:x1875537603605504:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 39us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652255.923684:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 46 00000100:00100000:3.0:1788652255.923696:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 47 00000100:00100000:3.0:1788652255.923702:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2347:x1875537603605632:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1788652255.923722:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2347:x1875537603605632:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 21us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652255.923728:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 47 00000100:00080000:1.0:1788652255.924623:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788652255.924629:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788652255.924632:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652256.399426:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627756544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788652256.399494:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652256.399592:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627756544 00000100:00100000:2.0:1788652256.399600:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627756544 00000100:00100000:2.0:1788652256.399639:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788652256.399647:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627756544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788652256.399680:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788652256.399718:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627756544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652256.399724:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788652256.399786:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe493b8e00 x1875537627756544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652256.399803:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627756544:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788652256.527369:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652257.416890:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788652257.416915:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b04e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627756672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788652257.416980:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652257.417113:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627756672 00000100:00100000:1.0:1788652257.417120:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627756672 00000100:00100000:1.0:1788652257.417210:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788652257.417220:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627756672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788652257.417250:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788652257.417302:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75985880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627756672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652257.417309:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788652257.417430:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788652257.417455:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe4b04e300 x1875537627756672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652257.417472:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b04e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627756672:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788652257.546958:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652258.568035:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652259.605959:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652260.618839:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652261.000488:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b04f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627757056:0@lo:400:kworker.0 00000100:00100000:1.0:1788652261.000565:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652261.000624:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788652261.000631:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b04ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627757184:0@lo:400:kworker.0 00000100:00100000:1.0:1788652261.000656:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652261.000695:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627757056 00000100:00100000:1.0:1788652261.000703:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627757056 00000100:00100000:1.0:1788652261.000757:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788652261.000766:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627757056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652261.000852:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627757056:12345-0@lo:400:kworker.0 Request processed in 86us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652261.000872:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788652261.000896:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627757184 00000100:00100000:1.0:1788652261.000900:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627757184 00000100:00100000:1.0:1788652261.000927:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788652261.000933:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627757184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652261.000965:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627757184:12345-0@lo:400:kworker.0 Request processed in 32us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652261.000971:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788652261.000988:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788652261.000992:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788652261.001020:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe4b04ce00 x1875537627757184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652261.001046:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b04ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627757184:0@lo:400:kworker.0 00000100:00100000:1.0:1788652261.001058:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b04f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627757056:0@lo:400:kworker.0 00000100:00100000:3.0:1788652261.002694:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b04c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627756928:0@lo:400:kworker.0 00000100:00100000:3.0:1788652261.002757:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652261.002805:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b04df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627757440:0@lo:400:kworker.0 00000100:00100000:3.0:1788652261.002839:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652261.002876:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788652261.002883:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b04c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627756800:0@lo:400:kworker.0 00000100:00100000:3.0:1788652261.002919:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652261.002944:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b04c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875537627757312:0@lo:400:kworker.0 00000100:00100000:3.0:1788652261.002965:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652261.002997:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627756928 00000100:00100000:3.0:1788652261.003004:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627756928 00000100:00100000:3.0:1788652261.003057:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627757312 00000100:00100000:3.0:1788652261.003060:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627757312 00000100:00100000:3.0:1788652261.003088:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788652261.003096:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627756928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652261.003142:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627756928:12345-0@lo:400:kworker.0 Request processed in 47us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652261.003150:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788652261.003164:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788652261.003171:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875537627757312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652261.003199:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875537627757312:12345-0@lo:400:kworker.0 Request processed in 29us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652261.003204:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788652261.003222:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627757440 00000100:00100000:3.0:1788652261.003225:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627757440 00000100:00100000:3.0:1788652261.003251:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788652261.003257:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627757440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652261.003286:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627757440:12345-0@lo:400:kworker.0 Request processed in 29us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652261.003293:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788652261.003309:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627756800 00000100:00100000:3.0:1788652261.003312:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627756800 00000100:00100000:3.0:1788652261.003334:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788652261.003347:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:3304:x1875537627756800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652261.003375:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:3304:x1875537627756800:12345-0@lo:400:kworker.0 Request processed in 30us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652261.003381:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:3.0:1788652261.003415:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788652261.003419:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652261.003444:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b04c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627756800:0@lo:400:kworker.0 00000100:00100000:3.0:1788652261.003457:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b04c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875537627757312:0@lo:400:kworker.0 00000100:00100000:3.0:1788652261.003467:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b04c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627756928:0@lo:400:kworker.0 00010000:00080000:3.0:1788652261.003477:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe4b04df80 x1875537627757440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652261.003487:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b04df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627757440:0@lo:400:kworker.0 00000100:00100000:0.0:1788652261.040938:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652261.040981:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652261.041010:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652261.041046:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652261.041116:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652261.041145:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603606016 00000100:00100000:0.0:1788652261.041157:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603606016 00000100:00100000:0.0:1788652261.041221:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603605888 00000100:00100000:0.0:1788652261.041224:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603605888 00000100:00100000:0.0:1788652261.041248:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 80 00000100:00100000:0.0:1788652261.041257:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2348:x1875537603606016:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1788652261.041327:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2348:x1875537603606016:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 71us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652261.041335:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 80 00000100:00100000:0.0:1788652261.041350:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 81 00000100:00100000:0.0:1788652261.041356:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2348:x1875537603605888:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1788652261.041378:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2348:x1875537603605888:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 23us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652261.041397:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 81 00000100:00080000:0.0:1788652261.041417:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652261.041615:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603605760 00000100:00100000:2.0:1788652261.041620:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603605760 00000100:00100000:2.0:1788652261.041661:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 226 00000100:00100000:2.0:1788652261.041668:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2348:x1875537603605760:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652261.041696:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2348:x1875537603605760:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 29us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652261.041702:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 226 00000100:00100000:1.0:1788652261.042048:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603606144 00000100:00100000:1.0:1788652261.042053:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603606144 00000100:00100000:1.0:1788652261.042099:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603606272 00000100:00100000:1.0:1788652261.042103:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603606272 00000100:00100000:1.0:1788652261.042125:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00100000:1.0:1788652261.042132:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2345:x1875537603606144:12345-192.168.203.50@tcp:9:kworker.0 00000020:00000080:1.0:1788652261.042153:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a7615 00000100:00080000:1.0:1788652261.042163:0:6679:0:(import.c:65:import_set_state_nolock()) ffff8cbe81d1d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788652261.042200:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788652261.042512:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3eb94160-5684-49f0-9e45-fbf338e18f8d+2:2345:x1875537603606144:12345-192.168.203.50@tcp:9:kworker.0 Request processed in 379us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652261.042520:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00100000:1.0:1788652261.042545:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00100000:1.0:1788652261.042552:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2345:x1875537603606272:12345-192.168.203.50@tcp:9:kworker.0 00000020:00000080:1.0:1788652261.042565:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a761c 00000100:00080000:1.0:1788652261.042571:0:6679:0:(import.c:65:import_set_state_nolock()) ffff8cbe81d1e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788652261.042594:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788652261.042819:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3eb94160-5684-49f0-9e45-fbf338e18f8d+2:2345:x1875537603606272:12345-192.168.203.50@tcp:9:kworker.0 Request processed in 258us (1693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652261.042826:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 15 00010000:00010000:1.0:1788652261.042997:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652261.043004:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788652261.043071:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788652261.043076:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1788652261.120513:0:11003:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788652261.512352:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627757568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788652261.512440:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652261.512559:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627757568 00000100:00100000:0.0:1788652261.512568:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627757568 00000100:00100000:0.0:1788652261.512625:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788652261.512634:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627757568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788652261.512686:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788652261.518593:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627757568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5948us (6141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652261.518609:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788652261.522731:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe493b8e00 x1875537627757568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652261.522759:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627757568:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788652261.639996:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652262.536640:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788652262.536671:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b04ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627757696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788652262.536809:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652262.536843:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627757696 00000100:00100000:3.0:1788652262.536858:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627757696 00000100:00100000:3.0:1788652262.536927:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788652262.536938:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627757696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788652262.536971:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652262.537143:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627757696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 206us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652262.537153:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788652262.537183:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788652262.537340:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe4b04ce00 x1875537627757696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652262.537358:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b04ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627757696:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1788652262.624217:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3eb94160-5684-49f0-9e45-fbf338e18f8d 00000020:00000080:0.0:1788652262.624228:0:6704:0:(genops.c:885:class_export_put()) final put ffff8cbe81d18000/3eb94160-5684-49f0-9e45-fbf338e18f8d 00000020:00000080:2.0:1788652262.624452:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe81d18000/3eb94160-5684-49f0-9e45-fbf338e18f8d for lustre-OST0000 00000020:00000080:2.0:1788652262.624522:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe81d1d800 for lustre-OST0000 00010000:00010000:2.0:1788652262.666393:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652263.688634:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652264.712928:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788652264.992727:0:11151:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc77427de0 20000000:00000080:1.0:1788652264.992748:0:11151:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cbe7f8a8800 uarg=0000000000000000 20000000:01000000:1.0:1788652264.992940:0:11151:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788652264.992946:0:11151:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788652264.992950:0:11151:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788652264.993548:0:11152:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788652264.993752:0:11151:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788652265.002490:0:11151:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788652265.002535:0:11151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a7623 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652265.002554:0:11151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe52925c00/0x340ed74ef02a75cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a75c8 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652265.002563:0:11151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe52924e00/0x340ed74ef02a75dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a75d6 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652265.002570:0:11151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a75eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a75e4 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652265.002579:0:11151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe49e56a00/0x340ed74ef02a75f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07a9 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652265.002585:0:11151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe8215e000/0x340ed74ef02a7607 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07e1 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652265.002591:0:11151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a7623 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652265.002635:0:11151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe8215e000/0x340ed74ef02a7607 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07e1 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652265.002650:0:11151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe8215e000/0x340ed74ef02a7607 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07e1 expref: 12 pid: 5829 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652265.002663:0:11151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b04ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1875537627757824:192.168.203.50@tcp:104: 00010000:00010000:1.0:1788652265.002849:0:11151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe49e56a00/0x340ed74ef02a75f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07a9 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652265.002870:0:11151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe49e56a00/0x340ed74ef02a75f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07a9 expref: 12 pid: 5829 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652265.002879:0:11151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b04df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1875537627757952:192.168.203.50@tcp:104: 00010000:00010000:1.0:1788652265.002916:0:11151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a75eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a75e4 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652265.002924:0:11151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a75eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a75e4 expref: 18 pid: 5829 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652265.002932:0:11151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b04c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1875537627758080:0@lo:104: 00000100:00100000:1.0:1788652265.002969:0:11151:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788652265.003003:0:11151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe52924e00/0x340ed74ef02a75dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a75d6 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652265.003011:0:11151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe52924e00/0x340ed74ef02a75dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a75d6 expref: 18 pid: 5830 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652265.003019:0:11151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b04c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1875537627758208:0@lo:104: 00000100:00100000:1.0:1788652265.003039:0:11151:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788652265.003062:0:11151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe52925c00/0x340ed74ef02a75cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a75c8 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652265.003070:0:11151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe52925c00/0x340ed74ef02a75cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a75c8 expref: 18 pid: 5829 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652265.003077:0:11151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b04f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1875537627758336:0@lo:104: 00000100:00100000:1.0:1788652265.003096:0:11151:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652265.003119:0:11151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7f2cbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788652265.003254:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627758080 00000100:00100000:2.0:1788652265.003261:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627758080 00000100:00100000:2.0:1788652265.003298:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627758208 00000100:00100000:2.0:1788652265.003300:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627758208 00000100:00100000:2.0:1788652265.003308:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627758336 00000100:00100000:2.0:1788652265.003310:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627758336 00000100:00100000:2.0:1788652265.003321:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788652265.003330:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f811a652-691e-4a40-b660-977a4758dd08+5:11151:x1875537627758080:12345-0@lo:104: 00010000:00010000:2.0:1788652265.003354:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a75e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a75eb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652265.003410:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788652265.003417:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f811a652-691e-4a40-b660-977a4758dd08+5:11151:x1875537627758080:12345-0@lo:104: Request processed in 88us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652265.003429:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788652265.003446:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788652265.003452:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f811a652-691e-4a40-b660-977a4758dd08+4:11151:x1875537627758208:12345-0@lo:104: 00010000:00010000:2.0:1788652265.003460:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56800/0x340ed74ef02a75d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a75dd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652265.003492:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788652265.003497:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f811a652-691e-4a40-b660-977a4758dd08+4:11151:x1875537627758208:12345-0@lo:104: Request processed in 46us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652265.003502:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788652265.003513:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788652265.003519:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f811a652-691e-4a40-b660-977a4758dd08+3:11151:x1875537627758336:12345-0@lo:104: 00010000:00010000:2.0:1788652265.003526:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a75c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a75cf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652265.003550:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788652265.003555:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f811a652-691e-4a40-b660-977a4758dd08+3:11151:x1875537627758336:12345-0@lo:104: Request processed in 37us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652265.003561:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788652265.003576:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788652265.003581:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a75e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a75eb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652265.003588:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215fa00 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:2.0:1788652265.003592:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a75e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a75eb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652265.003610:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a75e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a75eb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652265.003617:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a75e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a75eb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652265.003623:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788652265.003649:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a75e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a75eb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652265.003655:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652265.003673:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a75e4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a75eb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652265.003681:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe8215fa00/0x340ed74ef02a75e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a75eb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652265.003694:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788652265.003697:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56800/0x340ed74ef02a75d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a75dd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652265.003702:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e56800 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:2.0:1788652265.003704:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56800/0x340ed74ef02a75d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a75dd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652265.003710:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56800/0x340ed74ef02a75d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a75dd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652265.003716:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56800/0x340ed74ef02a75d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a75dd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652265.003727:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788652265.003742:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56800/0x340ed74ef02a75d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a75dd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652265.003747:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652265.003753:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56800/0x340ed74ef02a75d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a75dd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652265.003759:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe49e56800/0x340ed74ef02a75d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a75dd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652265.003768:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788652265.004247:0:11151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b04c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1875537627758080:0@lo:104: 00000100:00100000:1.0:1788652265.004256:0:11151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b04c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1875537627758208:0@lo:104: 00000100:00100000:1.0:1788652265.004263:0:11151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b04f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1875537627758336:0@lo:104: 00000100:00100000:3.0:1788652265.004357:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627758592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788652265.004395:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652265.004479:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627758592 00000100:00100000:0.0:1788652265.004485:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627758592 00000100:00100000:3.0:1788652265.004488:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788652265.004494:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627758464:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788652265.004508:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe52924e00/0x340ed74ef02a75dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a75d6 expref: 19 pid: 5830 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652265.004516:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788652265.005522:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a75c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a75cf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652265.005532:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e57c00 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:2.0:1788652265.005665:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a75c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a75cf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652265.005675:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a75c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a75cf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652265.005683:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a75c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a75cf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652265.005689:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788652265.005733:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a75c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a75cf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652265.005740:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652265.005906:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a75c8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a75cf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652265.005984:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57c00/0x340ed74ef02a75c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a75cf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652265.006109:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652265.006111:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652265.006114:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652265.006169:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652265.006180:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788652265.006198:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627758720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652265.006246:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652265.009937:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627758464 00000100:00100000:0.0:1788652265.009951:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627758464 00010000:00010000:0.0:1788652265.009991:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a75eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a75e4 expref: 20 pid: 5829 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652265.010017:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627758720 00000100:00100000:0.0:1788652265.010020:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627758720 00010000:00010000:0.0:1788652265.010032:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe52925c00/0x340ed74ef02a75cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a75c8 expref: 21 pid: 5829 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652265.010046:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788652265.010070:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51233050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+21:3304:x1875537627758592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788652265.010084:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652265.010090:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe52924e00/0x340ed74ef02a75dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a75d6 expref: 21 pid: 5830 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652265.010100:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe52924e00/0x340ed74ef02a75dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a75d6 expref: 21 pid: 5830 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652265.010116:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe52924e00/0x340ed74ef02a75dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a75d6 expref: 21 pid: 5830 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652265.010131:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652265.010197:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51233050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+20:3304:x1875537627758592:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (5799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652265.010204:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788652265.010245:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788652265.010250:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75987b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+19:3304:x1875537627758464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788652265.010256:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652265.010260:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a75eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a75e4 expref: 19 pid: 5829 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652265.010267:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a75eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a75e4 expref: 19 pid: 5829 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652265.010277:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a75eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a75e4 expref: 19 pid: 5829 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652265.010285:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652265.010304:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75987b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+18:3304:x1875537627758464:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (5787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652265.010315:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788652265.010326:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788652265.010332:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+17:3306:x1875537627758720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788652265.010349:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652265.010354:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe52925c00/0x340ed74ef02a75cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a75c8 expref: 17 pid: 5829 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652265.010362:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe52925c00/0x340ed74ef02a75cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a75c8 expref: 17 pid: 5829 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652265.010371:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe52925c00/0x340ed74ef02a75cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a75c8 expref: 17 pid: 5829 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652265.010379:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652265.010405:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+16:3306:x1875537627758720:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (4158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652265.010411:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788652265.010547:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627758464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652265.010560:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627758592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652265.010590:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627758720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788652265.010847:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652265.010875:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652265.010892:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603606400 00000100:00100000:3.0:1788652265.010896:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603606400 00010000:00010000:3.0:1788652265.010916:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe8215e000/0x340ed74ef02a7607 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07e1 expref: 13 pid: 5829 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652265.010930:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603606528 00000100:00100000:3.0:1788652265.010933:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603606528 00010000:00010000:3.0:1788652265.010944:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe49e56a00/0x340ed74ef02a75f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07a9 expref: 14 pid: 5829 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652265.010955:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 28 00000100:00100000:3.0:1788652265.010960:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75986300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+14:2349:x1875537603606400:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652265.010968:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652265.010972:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe8215e000/0x340ed74ef02a7607 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07e1 expref: 14 pid: 5829 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652265.010982:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe8215e000/0x340ed74ef02a7607 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07e1 expref: 14 pid: 5829 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652265.010993:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652265.011040:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75986300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+14:2349:x1875537603606400:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 79us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652265.011046:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 28 00000100:00100000:3.0:1788652265.011060:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 29 00000100:00100000:3.0:1788652265.011067:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75985c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2349:x1875537603606528:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652265.011075:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652265.011079:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe49e56a00/0x340ed74ef02a75f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07a9 expref: 13 pid: 5829 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652265.011087:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe49e56a00/0x340ed74ef02a75f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07a9 expref: 13 pid: 5829 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652265.011100:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a7623 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652265.011108:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a7623 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652265.011122:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a7623 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652265.011129:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a7623 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652265.011136:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a7623 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652265.011142:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a7623 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652265.011148:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe52925e00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:3.0:1788652265.011158:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a7623 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652265.011167:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a7623 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652265.011177:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a7623 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652265.011187:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652265.011205:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75985c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2349:x1875537603606528:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 139us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652265.011211:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 29 00010000:00010000:0.0:1788652265.012288:0:11151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe8215e000/0x340ed74ef02a7607 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07e1 expref: 12 pid: 5829 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652265.012307:0:11151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b04ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1875537627757824:192.168.203.50@tcp:104: 00010000:00010000:0.0:1788652265.012320:0:11151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe49e56a00/0x340ed74ef02a75f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07a9 expref: 11 pid: 5829 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652265.012328:0:11151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b04df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11151:1875537627757952:192.168.203.50@tcp:104: 00010000:00010000:0.0:1788652265.012375:0:11151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a7623 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652265.012402:0:11151:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a7623 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652265.012408:0:11151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a7623 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652265.012415:0:11151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a7623 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1788652265.662259:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3eb94160-5684-49f0-9e45-fbf338e18f8d 00000020:00000080:1.0:1788652265.662269:0:7631:0:(genops.c:885:class_export_put()) final put ffff8cbe81d1b800/3eb94160-5684-49f0-9e45-fbf338e18f8d 00000020:00000080:2.0:1788652265.662406:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe81d1b800/3eb94160-5684-49f0-9e45-fbf338e18f8d for lustre-OST0001 00000020:00000080:2.0:1788652265.662459:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe81d1e800 for lustre-OST0001 00010000:00010000:2.0:1788652265.744487:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652266.131137:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788652266.131171:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a0c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627759232:0@lo:400:kworker.0 00000100:00100000:0.0:1788652266.131214:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a0c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875537627759360:0@lo:400:kworker.0 00000100:00100000:3.0:1788652266.131452:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627758976:0@lo:400:kworker.0 00000100:00100000:2.0:1788652266.131601:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875537627759104:0@lo:400:kworker.0 00000100:00100000:1.0:1788652266.138982:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652266.138982:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652266.139069:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652266.139407:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627758848:0@lo:400:kworker.0 00000100:00100000:1.0:1788652266.139495:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652266.139627:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627759232 00000100:00100000:1.0:1788652266.139635:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627759232 00000100:00100000:1.0:1788652266.139692:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788652266.139703:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627759232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652266.139759:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627759232:12345-0@lo:400:kworker.0 Request processed in 58us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652266.139765:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788652266.139819:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627758848 00000100:00100000:1.0:1788652266.139823:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627758848 00000100:00100000:1.0:1788652266.139848:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788652266.139854:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+16:3305:x1875537627758848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652266.139884:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+16:3305:x1875537627758848:12345-0@lo:400:kworker.0 Request processed in 30us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652266.139889:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:1.0:1788652266.139912:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788652266.139959:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a0c0700 x1875537627759232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652266.139973:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a0c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627759232:0@lo:400:kworker.0 00000100:00100000:1.0:1788652266.139983:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627758848:0@lo:400:kworker.0 00000100:00100000:3.0:1788652266.140095:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627759488:0@lo:400:kworker.0 00000100:00100000:2.0:1788652266.140419:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652266.140469:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627759360 00000100:00100000:2.0:1788652266.140474:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627759360 00000100:00100000:2.0:1788652266.140512:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627758976 00000100:00100000:2.0:1788652266.140515:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627758976 00000100:00100000:2.0:1788652266.140602:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627759104 00000100:00100000:2.0:1788652266.140607:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627759104 00000100:00100000:2.0:1788652266.140629:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788652266.140646:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875537627759360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652266.140688:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875537627759360:12345-0@lo:400:kworker.0 Request processed in 45us (1722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652266.140695:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788652266.140710:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788652266.140717:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627758976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652266.140743:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627758976:12345-0@lo:400:kworker.0 Request processed in 27us (1675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652266.140749:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788652266.140759:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788652266.140764:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875537627759104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652266.140823:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875537627759104:12345-0@lo:400:kworker.0 Request processed in 58us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652266.140829:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788652266.140863:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a0c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875537627759360:0@lo:400:kworker.0 00000100:00080000:2.0:1788652266.140879:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652266.140926:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875537627759104:0@lo:400:kworker.0 00000100:00100000:3.0:1788652266.143509:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652266.143652:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627758976:0@lo:400:kworker.0 00000100:00100000:1.0:1788652266.144913:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627759488 00000100:00100000:1.0:1788652266.144924:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627759488 00000100:00100000:1.0:1788652266.145028:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788652266.145038:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe74acce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627759488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652266.145128:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe74acce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627759488:12345-0@lo:400:kworker.0 Request processed in 91us (1626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652266.145136:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1788652266.148441:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788652266.148517:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a0c3480 x1875537627759488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652266.148613:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a0c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627759488:0@lo:400:kworker.0 00000100:00100000:3.0:1788652266.160648:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652266.160689:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652266.160728:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652266.160757:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603606912 00000100:00100000:3.0:1788652266.160766:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603606912 00000100:00100000:3.0:1788652266.160856:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603606784 00000100:00100000:3.0:1788652266.160860:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603606784 00000100:00100000:3.0:1788652266.160882:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 85 00000100:00100000:3.0:1788652266.160891:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe74acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2346:x1875537603606912:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1788652266.160958:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe74acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2346:x1875537603606912:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 68us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652266.160966:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 85 00000100:00100000:3.0:1788652266.160982:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 86 00000100:00100000:3.0:1788652266.160989:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe74acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2346:x1875537603606784:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1788652266.161010:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe74acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2346:x1875537603606784:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 22us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652266.161016:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 86 00000100:00080000:3.0:1788652266.161135:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788652266.161799:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603606656 00000100:00100000:0.0:1788652266.161806:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603606656 00000100:00100000:0.0:1788652266.161840:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 228 00000100:00100000:0.0:1788652266.161847:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+11:2346:x1875537603606656:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1788652266.161894:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+11:2346:x1875537603606656:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 47us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652266.161901:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 228 00000100:00100000:2.0:1788652266.634454:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a0c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627759616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788652266.634522:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652266.634857:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627759616 00000100:00100000:1.0:1788652266.634865:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627759616 00000100:00100000:1.0:1788652266.634928:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788652266.634945:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627759616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788652266.634983:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788652266.635261:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627759616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 323us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652266.635269:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788652266.635310:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a0c0000 x1875537627759616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652266.635328:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a0c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627759616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788652266.749535:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652266.752498:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603607040 00000100:00100000:1.0:1788652266.752516:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603607040 00000100:00100000:1.0:1788652266.753501:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 229 00000100:00100000:1.0:1788652266.753518:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+11:5588:x1875537603607040:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788652266.753552:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652266.753573:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe52924e00/0x340ed74ef02a762a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f080b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652266.753602:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe52924e00/0x340ed74ef02a762a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f080b expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652266.753625:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe52924e00/0x340ed74ef02a762a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f080b expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652266.753634:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe52924e00, rc 0) 00000100:00100000:1.0:1788652266.753690:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+12:5588:x1875537603607040:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 Request processed in 178us (4177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652266.753698:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 229 10000000:01000000:1.0:1788652266.760008:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788652266.760017:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe7fdf4800 from 7 10000000:01000000:1.0:1788652266.760024:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788652266.760071:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52924400/0x340ed74ef02a7631 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652266.760084:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe52924400/0x340ed74ef02a7631 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652266.760095:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe52924400/0x340ed74ef02a7631 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652266.760119:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b04df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627759744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788652266.760183:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652266.760237:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7f2cbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788652266.760296:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627759744 00000100:00100000:3.0:1788652266.760303:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627759744 00000100:00100000:3.0:1788652266.760365:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788652266.760374:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+16:5832:x1875537627759744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652266.760386:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652266.760400:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7a0e5400/0x340ed74ef02a7638 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a7631 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652266.760423:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7a0e5400/0x340ed74ef02a7638 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a7631 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652266.760433:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7a0e5400/0x340ed74ef02a7638 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a7631 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652266.760451:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5400, rc 0) 00000100:00100000:3.0:1788652266.760494:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627759744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652266.760501:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788652266.760752:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b04df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627759744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652266.760768:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe52924400/0x340ed74ef02a7631 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7638 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652266.760807:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe52924400/0x340ed74ef02a7631 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a7638 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652266.760866:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe74ace680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627759872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652266.760894:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652266.760912:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5138c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788652266.760981:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627759872 00000100:00100000:1.0:1788652266.760986:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627759872 00000100:00100000:1.0:1788652266.761016:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788652266.761022:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627759872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788652266.761253:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627759872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652266.761260:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788652266.761411:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe74ace680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627759872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652266.761454:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe74ace680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627760000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788652266.761505:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788652266.761631:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652266.761958:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5138c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788652266.762015:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627760000 00000100:00100000:1.0:1788652266.762020:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627760000 00000100:00100000:1.0:1788652266.762048:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788652266.762055:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627760000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788652266.762224:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627760000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652266.762231:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788652266.762465:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe74ace680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627760000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788652266.764675:0:11203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788652266.765081:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788652266.765102:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788652266.765114:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52924400/0x340ed74ef02a7631 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7638 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652266.765147:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe52924400/0x340ed74ef02a7631 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7638 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652266.765158:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788652266.765161:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe818bc800 from 7 10000000:01000000:2.0:1788652266.765164:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788652266.765199:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e400/0x340ed74ef02a763f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652266.765206:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e400/0x340ed74ef02a763f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652266.765215:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e400/0x340ed74ef02a763f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652266.765240:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627760128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788652266.765301:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652266.765354:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe81bce000 going to sleep for 11 seconds 00000100:00100000:3.0:1788652266.765491:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627760128 00000100:00100000:3.0:1788652266.765498:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627760128 00000100:00100000:3.0:1788652266.765549:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788652266.765559:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627760128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652266.765578:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652266.765590:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7a0e4c00/0x340ed74ef02a7646 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a763f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652266.765621:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7a0e4c00/0x340ed74ef02a7646 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a763f expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652266.765631:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7a0e4c00/0x340ed74ef02a7646 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a763f expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652266.765640:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e4c00, rc 0) 00000100:00100000:3.0:1788652266.765686:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627760128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652266.765692:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788652266.765920:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627760128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788652266.765934:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e400/0x340ed74ef02a763f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7646 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652266.765943:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e400/0x340ed74ef02a763f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a7646 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652266.765994:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627760256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788652266.766019:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652266.766052:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe81bce000 going to sleep for 11 seconds 00000100:00100000:3.0:1788652266.766122:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627760256 00000100:00100000:3.0:1788652266.766126:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627760256 00000100:00100000:3.0:1788652266.766147:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788652266.766153:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627760256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652266.766405:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627760256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652266.766412:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788652266.766486:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627760256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788652266.766513:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627760384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788652266.766559:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652266.766579:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe81bce000 going to sleep for 11 seconds 00000100:00100000:3.0:1788652266.766767:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627760384 00000100:00100000:3.0:1788652266.766797:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627760384 00000100:00100000:3.0:1788652266.766828:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788652266.766834:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627760384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788652266.766975:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627760384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652266.766991:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788652266.767077:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627760384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788652266.767998:0:11204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788652266.768290:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788652266.768312:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788652266.768322:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e400/0x340ed74ef02a763f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7646 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652266.768345:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e400/0x340ed74ef02a763f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7646 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652266.768357:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788652266.768359:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe50c46000 from 7 10000000:01000000:3.0:1788652266.768362:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788652266.768397:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a764d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652266.768406:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a764d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652266.768416:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a764d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652266.768437:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe74ace680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627760512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788652266.768489:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652266.768530:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe487eab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788652266.768882:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627760512 00000100:00100000:2.0:1788652266.768889:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627760512 00000100:00100000:2.0:1788652266.768927:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788652266.768936:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627760512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788652266.768947:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652266.768959:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe8215e200/0x340ed74ef02a7654 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a764d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652266.768980:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe8215e200/0x340ed74ef02a7654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a764d expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652266.768990:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe8215e200/0x340ed74ef02a7654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a764d expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652266.768998:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215e200, rc 0) 00000100:00100000:2.0:1788652266.769037:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:5832:x1875537627760512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652266.769044:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788652266.769086:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe74ace680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627760512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788652266.769099:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a764d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7654 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652266.769122:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a764d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a7654 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652266.769170:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627760640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788652266.769195:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652266.769209:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe81bcee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788652266.769220:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627760640 00000100:00100000:2.0:1788652266.769223:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627760640 00000100:00100000:2.0:1788652266.769240:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788652266.769246:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:5832:x1875537627760640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652266.770668:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652266.770694:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603607168 00000100:00100000:3.0:1788652266.770701:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603607168 00000100:00100000:3.0:1788652266.770733:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 238 00000100:00100000:3.0:1788652266.770741:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+12:5588:x1875537603607168:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788652266.771232:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:5832:x1875537627760640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1983us (2033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652266.771241:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788652266.771314:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627760640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652266.775189:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+12:5588:x1875537603607168:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 Request processed in 4433us (4515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652266.775206:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 238 00000100:00100000:2.0:1788652266.775873:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627760768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788652266.775948:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652266.775989:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe81bcee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788652266.776078:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627760768 00000100:00100000:3.0:1788652266.776086:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627760768 00000100:00100000:3.0:1788652266.776132:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788652266.776141:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:5832:x1875537627760768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788652266.776352:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:5832:x1875537627760768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 212us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652266.776360:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788652266.776546:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627760768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788652266.778219:0:11205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788652266.784747:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788652266.784802:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788652266.784813:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a764d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7654 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652266.784827:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a764d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7654 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652266.784980:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652266.785097:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603607296 00000100:00100000:3.0:1788652266.785106:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603607296 00000100:00100000:3.0:1788652266.785159:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 240 00000100:00100000:3.0:1788652266.785168:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+12:5588:x1875537603607296:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788652266.785684:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+12:5588:x1875537603607296:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 Request processed in 514us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652266.785692:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 240 00000100:00100000:1.0:1788652266.816310:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652266.816400:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603607424 00000100:00100000:3.0:1788652266.816423:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603607424 00000100:00100000:3.0:1788652266.816478:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 241 00000100:00100000:3.0:1788652266.816488:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+12:5588:x1875537603607424:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652266.816504:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652266.816521:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7a0e5200/0x340ed74ef02a765b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0812 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652266.816558:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7a0e5200/0x340ed74ef02a765b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0812 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652266.816571:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7a0e5200/0x340ed74ef02a765b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0812 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652266.816580:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5200, rc 0) 00000100:00100000:3.0:1788652266.816929:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:5588:x1875537603607424:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 Request processed in 441us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652266.816937:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 241 00000100:00100000:1.0:1788652266.830059:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652266.835196:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603607552 00000100:00100000:2.0:1788652266.835210:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603607552 00000100:00100000:2.0:1788652266.835268:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 242 00000100:00100000:2.0:1788652266.835278:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:5588:x1875537603607552:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788652266.835541:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:5588:x1875537603607552:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 Request processed in 263us (5495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652266.835555:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 242 00000100:00100000:1.0:1788652266.839559:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652266.839923:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603607680 00000100:00100000:3.0:1788652266.839933:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603607680 00000100:00100000:3.0:1788652266.839986:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 243 00000100:00100000:3.0:1788652266.839997:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:5588:x1875537603607680:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788652266.840212:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:5588:x1875537603607680:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 Request processed in 215us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652266.840220:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 243 00000100:00100000:3.0:1788652267.655995:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788652267.656019:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe74acf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627760896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788652267.656086:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652267.656448:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627760896 00000100:00100000:3.0:1788652267.656457:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627760896 00000100:00100000:3.0:1788652267.656505:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788652267.656514:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe74aced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627760896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788652267.656550:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652267.656596:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe74aced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627760896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652267.656603:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788652267.656987:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe74acf100 x1875537627760896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652267.657007:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe74acf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627760896:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788652267.787218:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652268.813150:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788652269.396246:0:11351:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788652269.832346:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652270.856152:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652271.240211:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627761152:0@lo:400:kworker.0 00000100:00100000:2.0:1788652271.240319:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652271.240380:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627761664:0@lo:400:kworker.0 00000100:00100000:2.0:1788652271.240408:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652271.240441:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788652271.240447:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627761280:0@lo:400:kworker.0 00000100:00100000:2.0:1788652271.240486:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652271.240523:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627761152 00000100:00100000:2.0:1788652271.240532:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627761152 00000100:00100000:2.0:1788652271.240585:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627761280 00000100:00100000:2.0:1788652271.240589:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627761280 00000100:00100000:2.0:1788652271.240626:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788652271.240636:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627761152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652271.240696:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627761152:12345-0@lo:400:kworker.0 Request processed in 62us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652271.240705:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788652271.240723:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788652271.240729:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627761280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652271.240768:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627761280:12345-0@lo:400:kworker.0 Request processed in 39us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652271.240800:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788652271.240829:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627761664 00000100:00100000:2.0:1788652271.240834:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627761664 00000100:00100000:2.0:1788652271.240866:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788652271.240873:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627761664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652271.241069:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627761408:0@lo:400:kworker.0 00000100:00100000:1.0:1788652271.241108:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652271.241139:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788652271.241147:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627761024:0@lo:400:kworker.0 00000100:00100000:1.0:1788652271.241178:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652271.241206:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627761536:0@lo:400:kworker.0 00000100:00100000:1.0:1788652271.241233:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652271.241260:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627761408 00000100:00100000:1.0:1788652271.241272:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627761408 00000100:00100000:1.0:1788652271.241316:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788652271.241325:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627761408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652271.241367:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627761408:12345-0@lo:400:kworker.0 Request processed in 44us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652271.241375:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1788652271.241419:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe493b8e00 x1875537627761408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652271.241436:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627761408:0@lo:400:kworker.0 00000100:00100000:2.0:1788652271.241735:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627761664:12345-0@lo:400:kworker.0 Request processed in 862us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652271.241752:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788652271.241862:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627761536 00000100:00100000:2.0:1788652271.241867:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627761536 00000100:00100000:2.0:1788652271.241895:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788652271.241903:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627761536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652271.242046:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627761536:12345-0@lo:400:kworker.0 Request processed in 143us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652271.242054:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1788652271.242078:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788652271.242083:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788652271.242086:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652271.242108:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627761024 00000100:00100000:2.0:1788652271.242112:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627761024 00000100:00100000:2.0:1788652271.242149:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788652271.242156:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:3305:x1875537627761024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652271.242184:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:3305:x1875537627761024:12345-0@lo:400:kworker.0 Request processed in 30us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652271.242190:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788652271.242238:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627761280:0@lo:400:kworker.0 00000100:00100000:2.0:1788652271.242254:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627761152:0@lo:400:kworker.0 00010000:00080000:2.0:1788652271.242266:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe493b9c00 x1875537627761664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652271.242285:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627761664:0@lo:400:kworker.0 00000100:00100000:1.0:1788652271.242544:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627761536:0@lo:400:kworker.0 00000100:00100000:1.0:1788652271.242562:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627761024:0@lo:400:kworker.0 00000100:00100000:2.0:1788652271.288171:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652271.288230:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652271.288240:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603607808 00000100:00100000:1.0:1788652271.288254:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603607808 00000100:00100000:2.0:1788652271.288268:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603607936 00000100:00100000:2.0:1788652271.288271:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603607936 00000100:00100000:2.0:1788652271.288323:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 90 00000100:00100000:1.0:1788652271.288323:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 245 00000100:00100000:2.0:1788652271.288334:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2349:x1875537603607936:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652271.288334:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2349:x1875537603607808:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652271.288416:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2349:x1875537603607808:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 84us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652271.288425:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 245 00000100:00080000:0.0:1788652271.289264:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652271.291936:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2349:x1875537603607936:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 3587us (3688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652271.292056:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 90 00000100:00100000:3.0:1788652271.292379:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652271.296731:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603608064 00000100:00100000:2.0:1788652271.296761:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603608064 00000100:00100000:2.0:1788652271.296982:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 91 00000100:00100000:2.0:1788652271.296996:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe74acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2348:x1875537603608064:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652271.297118:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe74acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2348:x1875537603608064:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 126us (4739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652271.297126:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 91 00000100:00080000:3.0:1788652271.298387:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788652271.753678:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b04c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627761792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788652271.753753:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652271.753841:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627761792 00000100:00100000:0.0:1788652271.753848:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627761792 00000100:00100000:0.0:1788652271.753891:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788652271.753900:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627761792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788652271.754119:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788652271.754170:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627761792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 271us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652271.754177:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788652271.754217:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe4b04c700 x1875537627761792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652271.754235:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b04c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627761792:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788652271.881527:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652272.777406:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788652272.777430:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b04c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627761920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788652272.777496:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652272.777564:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627761920 00000100:00100000:1.0:1788652272.777572:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627761920 00000100:00100000:1.0:1788652272.777615:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788652272.777624:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627761920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788652272.777662:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788652272.777708:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627761920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652272.777716:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1788652272.778443:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe4b04c380 x1875537627761920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652272.778472:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b04c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627761920:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788652272.911710:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788652273.033943:0:11453:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 19:51:10 (1788652270) === 00000100:00100000:3.0:1788652273.223935:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652273.223985:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652273.224637:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603608192 00000100:00100000:0.0:1788652273.224648:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603608192 00000100:00100000:0.0:1788652273.224806:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00100000:0.0:1788652273.224819:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe74acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2346:x1875537603608192:12345-192.168.203.50@tcp:41:mkdir.0 00000004:00000024:0.0:1788652273.224864:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788652273.224961:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe74acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2346:x1875537603608192:12345-192.168.203.50@tcp:41:mkdir.0 Request processed in 146us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652273.224969:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00080000:3.0:1788652273.225041:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788652273.225276:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603608320 00000100:00100000:1.0:1788652273.225282:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603608320 00000100:00100000:1.0:1788652273.225313:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:1.0:1788652273.225320:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe74acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:9668:x1875537603608320:12345-192.168.203.50@tcp:700:mkdir.0 00000100:00100000:1.0:1788652273.225367:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe74acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:9668:x1875537603608320:12345-192.168.203.50@tcp:700:mkdir.0 Request processed in 47us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652273.225374:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:3.0:1788652273.230129:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652273.234057:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603608576 00000100:00100000:2.0:1788652273.234076:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603608576 00000100:00100000:3.0:1788652273.235346:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00100000:3.0:1788652273.235363:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe74acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:9668:x1875537603608576:12345-192.168.203.50@tcp:36:mkdir.0 00010000:00010000:3.0:1788652273.235452:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652273.235498:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7543 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0794 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.235535:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe485ac000) 00010000:00010000:3.0:1788652273.235565:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788652273.236028:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7662 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.236046:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7662 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.236057:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7662 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.236071:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7669 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.236078:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7669 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.236085:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7669 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652273.237473:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788652273.237495:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7662 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.237506:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7662 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.237514:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7662 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.237520:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652273.237526:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7662 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.237547:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7662 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.237566:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe7fde3200) 00010000:00010000:3.0:1788652273.237570:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652273.237576:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7662 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.237584:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7662 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788652273.237607:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006de3b937 reply state 0000000021f91ce7 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7669 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652273.237618:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788652273.237817:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe74acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:9668:x1875537603608576:12345-192.168.203.50@tcp:36:mkdir.0 Request processed in 2411us (7653us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788652273.237829:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 15 00010000:00010000:1.0:1788652273.244608:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7669 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.244629:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7669 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.244637:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7669 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.244643:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652273.244648:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7669 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.244656:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7669 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.244693:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cbe7fde3700) 00010000:00010000:1.0:1788652273.244697:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652273.244702:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7669 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.244709:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7669 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652273.248281:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652273.248467:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603608704 00000100:00100000:0.0:1788652273.248480:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603608704 00000100:00100000:0.0:1788652273.248558:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:0.0:1788652273.248570:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe74acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:9669:x1875537603608704:12345-192.168.203.50@tcp:101:chmod.0 00010000:00010000:0.0:1788652273.248597:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652273.248629:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a7670 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0819 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.248713:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a7677 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.248742:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a7677 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.248813:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a7677 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652273.248862:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788652273.248868:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788652273.248915:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a7677 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.248962:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a7670 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0819 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.248984:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a7677 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0819 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.248994:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe48888d00) 00010000:00010000:0.0:1788652273.248996:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788652273.249001:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e56800, rc 0) 00000100:00100000:0.0:1788652273.249084:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe74acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:9669:x1875537603608704:12345-192.168.203.50@tcp:101:chmod.0 Request processed in 516us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652273.249091:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:3.0:1788652273.260402:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652273.260537:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603608960 00000100:00100000:2.0:1788652273.260551:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603608960 00000100:00100000:2.0:1788652273.260633:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:2.0:1788652273.260646:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe74acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:9669:x1875537603608960:12345-192.168.203.50@tcp:36:chmod.0 00010000:00010000:2.0:1788652273.260759:0:6701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652273.260842:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a7677 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0819 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.260867:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe48888d00) 00010000:00010000:2.0:1788652273.260880:0:6701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788652273.260915:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a767e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.260929:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a767e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.260940:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a767e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788652273.261342:0:6701:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0bba6a0 reply state 000000002181bd3f transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a767e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652273.261354:0:6701:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788652273.261364:0:6701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788652273.263581:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe74acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:9669:x1875537603608960:12345-192.168.203.50@tcp:36:chmod.0 Request processed in 2924us (3177us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788652273.263595:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 17 00010000:00010000:1.0:1788652273.271643:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a767e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.271663:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a767e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.271683:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a767e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.271689:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652273.271695:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a767e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.271705:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a767e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.271727:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:1.0:1788652273.271737:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788652273.271742:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a767e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.271749:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a767e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652273.304233:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652273.306323:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603609088 00000100:00100000:2.0:1788652273.306339:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603609088 00000100:00100000:2.0:1788652273.306475:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:2.0:1788652273.306766:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe74acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:9670:x1875537603609088:12345-192.168.203.50@tcp:101:chown.0 00010000:00010000:2.0:1788652273.306829:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652273.306858:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f800/0x340ed74ef02a7685 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0820 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.306935:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a768c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.306966:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a768c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.306981:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a768c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652273.307023:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788652273.307028:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788652273.307069:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a768c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.307268:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f800/0x340ed74ef02a7685 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0820 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.307349:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a768c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0820 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.307359:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe485ac800) 00010000:00010000:2.0:1788652273.307362:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788652273.307366:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215f400, rc 0) 00000100:00100000:2.0:1788652273.307439:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe74acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:9670:x1875537603609088:12345-192.168.203.50@tcp:101:chown.0 Request processed in 947us (3220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652273.307446:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:3.0:1788652273.314304:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652273.314403:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603609216 00000100:00100000:0.0:1788652273.314417:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603609216 00000100:00100000:0.0:1788652273.314506:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:0.0:1788652273.314517:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe74acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:9670:x1875537603609216:12345-192.168.203.50@tcp:101:chown.0 00010000:00010000:0.0:1788652273.314538:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652273.314569:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a7693 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0827 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.314658:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57c00/0x340ed74ef02a769a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.314674:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57c00/0x340ed74ef02a769a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.314686:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57c00/0x340ed74ef02a769a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.314713:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56a00/0x340ed74ef02a76a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.314720:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56a00/0x340ed74ef02a76a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.314736:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56a00/0x340ed74ef02a76a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.314869:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57400/0x340ed74ef02a76a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.314878:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57400/0x340ed74ef02a76a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.314886:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57400/0x340ed74ef02a76a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652273.314916:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788652273.314920:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788652273.314941:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57400/0x340ed74ef02a76a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.314963:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57c00/0x340ed74ef02a769a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.314969:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57c00/0x340ed74ef02a769a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.314975:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57c00/0x340ed74ef02a769a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.314980:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e57c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652273.314984:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57c00/0x340ed74ef02a769a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.314991:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57c00/0x340ed74ef02a769a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.315003:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe485ac800) 00010000:00010000:0.0:1788652273.315006:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652273.315011:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57c00/0x340ed74ef02a769a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.315017:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57c00/0x340ed74ef02a769a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.315030:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56a00/0x340ed74ef02a76a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.315036:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56a00/0x340ed74ef02a76a1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.315042:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56a00/0x340ed74ef02a76a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.315054:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e56a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652273.315057:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56a00/0x340ed74ef02a76a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.315064:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56a00/0x340ed74ef02a76a1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.315072:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cbe48888c00) 00010000:00010000:0.0:1788652273.315074:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652273.315077:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56a00/0x340ed74ef02a76a1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.315083:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56a00/0x340ed74ef02a76a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.315124:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a7693 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0827 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.315138:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57400/0x340ed74ef02a76a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0827 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.315145:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cbe48888200) 00010000:00010000:0.0:1788652273.315147:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788652273.315150:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e57400, rc 0) 00000100:00100000:0.0:1788652273.315219:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe74acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:9670:x1875537603609216:12345-192.168.203.50@tcp:101:chown.0 Request processed in 704us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652273.315227:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:3.0:1788652273.320268:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652273.320393:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603609472 00000100:00100000:0.0:1788652273.320422:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603609472 00000100:00100000:0.0:1788652273.320498:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00100000:0.0:1788652273.320510:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe74acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:9670:x1875537603609472:12345-192.168.203.50@tcp:36:chown.0 00010000:00010000:0.0:1788652273.320593:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652273.320626:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57400/0x340ed74ef02a76a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0827 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.320650:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cbe48888200) 00010000:00010000:0.0:1788652273.320663:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788652273.320695:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a76af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.320711:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a76af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.320723:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a76af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788652273.405910:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1788652273.406080:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f3c3f6f reply state 000000007bd245b4 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a76af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652273.406118:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788652273.406137:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:3.0:1788652273.406270:0:5837:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788652273.406469:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe74acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:9670:x1875537603609472:12345-192.168.203.50@tcp:36:chown.0 Request processed in 85956us (86208us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788652273.406480:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 20 00010000:00010000:1.0:1788652273.407966:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a76af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.407988:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a76af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.407997:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a76af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.408004:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e56800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652273.408010:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a76af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.408020:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a76af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.408043:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cbe48888000) 00010000:00010000:1.0:1788652273.408047:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788652273.408054:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a76af lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.408062:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a76af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652273.444834:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652273.445504:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603609600 00000100:00100000:2.0:1788652273.445519:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603609600 00000100:00100000:2.0:1788652273.445603:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:2.0:1788652273.445615:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe74ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:9671:x1875537603609600:12345-192.168.203.50@tcp:101:touch.500 00010000:00010000:2.0:1788652273.445669:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652273.445700:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f800/0x340ed74ef02a76b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f082e expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788652273.448048:0:6701:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2225us 00010000:00010000:2.0:1788652273.468310:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a76bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.468336:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a76bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.468350:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a76bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.468368:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a76c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.468376:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a76c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.468383:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a76c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.468745:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a76cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.468754:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a76cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.468760:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a76cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652273.469058:0:6701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788652273.469071:0:6701:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788652273.469120:0:6701:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a76cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.469136:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a76bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.469144:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a76bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.469152:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a76bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.469159:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652273.469164:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a76bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.469173:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a76bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.469188:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe485ac800) 00010000:00010000:2.0:1788652273.469192:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652273.469198:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a76bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.469206:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a76bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.469220:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a76c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.469228:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a76c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.469244:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a76c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.469249:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215fc00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652273.469252:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a76c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.469259:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a76c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.469268:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cbe485ac700) 00010000:00010000:2.0:1788652273.469270:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652273.469274:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a76c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.469344:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a76c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.469396:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f800/0x340ed74ef02a76b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f082e expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.469414:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a76cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f082e expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.469423:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cbe485ac900) 00010000:00010000:2.0:1788652273.469426:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788652273.469429:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215fa00, rc 0) 00000100:00100000:2.0:1788652273.469524:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe74ace300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:9671:x1875537603609600:12345-192.168.203.50@tcp:101:touch.500 Request processed in 23911us (24701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652273.469547:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:3.0:1788652273.473557:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652273.474468:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603609856 00000100:00100000:2.0:1788652273.474748:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603609856 00000100:00100000:2.0:1788652273.475238:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 22 00000100:00100000:2.0:1788652273.475253:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe74acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:9671:x1875537603609856:12345-192.168.203.50@tcp:101:touch.500 00010000:00010000:2.0:1788652273.475281:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652273.475310:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a76d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0835 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.478369:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a76d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.478401:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a76d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.478416:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a76d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.480387:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030a00/0x340ed74ef02a76e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.480414:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030a00/0x340ed74ef02a76e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.480429:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030a00/0x340ed74ef02a76e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788652273.482864:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788652273.485106:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031000/0x340ed74ef02a76e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.485142:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031000/0x340ed74ef02a76e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.485155:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031000/0x340ed74ef02a76e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.485196:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a76d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.485203:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a76d9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.485211:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a76d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.485217:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe40031a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652273.485221:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a76d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.485228:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a76d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.485240:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cbe485ac900) 00010000:00010000:2.0:1788652273.485243:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652273.485248:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a76d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.485255:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a76d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788652273.485271:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b6274ef reply state 00000000bc6ba030 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030a00/0x340ed74ef02a76e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652273.485287:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788652273.485326:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a76d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0835 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.485342:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031000/0x340ed74ef02a76e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0835 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.485350:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cbe485acd00) 00010000:00010000:2.0:1788652273.485352:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788652273.485355:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe40031000, rc 0) 00000100:00100000:2.0:1788652273.485604:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe74acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+10:9671:x1875537603609856:12345-192.168.203.50@tcp:101:touch.500 Request processed in 10353us (12057us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788652273.485613:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 22 00010000:00010000:1.0:1788652273.488319:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030a00/0x340ed74ef02a76e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.488341:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030a00/0x340ed74ef02a76e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.488371:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030a00/0x340ed74ef02a76e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.488378:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe40030a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652273.488384:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030a00/0x340ed74ef02a76e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.488393:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030a00/0x340ed74ef02a76e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.488414:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x7eaa65ec (ffff8cbe485ace00) 00010000:00010000:1.0:1788652273.488418:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652273.488423:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030a00/0x340ed74ef02a76e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.488429:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030a00/0x340ed74ef02a76e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652273.489284:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652273.489414:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603610112 00000100:00100000:0.0:1788652273.489429:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603610112 00000100:00100000:0.0:1788652273.489501:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:0.0:1788652273.489515:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe74acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:9671:x1875537603610112:12345-192.168.203.50@tcp:36:touch.500 00010000:00010000:0.0:1788652273.489606:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652273.489634:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031000/0x340ed74ef02a76e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0835 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.489655:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cbe485acd00) 00010000:00010000:0.0:1788652273.489681:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788652273.489759:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a76f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.490180:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a76f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.490190:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a76f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788652273.490366:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5b6a17c reply state 00000000c940817a transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a76f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652273.490374:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788652273.490506:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe74acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+10:9671:x1875537603610112:12345-192.168.203.50@tcp:36:touch.500 Request processed in 991us (1228us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788652273.490516:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:3.0:1788652273.492497:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652273.492811:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603610240 00000100:00100000:0.0:1788652273.492825:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603610240 00000100:00100000:0.0:1788652273.492899:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 24 00000100:00100000:0.0:1788652273.492911:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe74acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+10:9671:x1875537603610240:12345-192.168.203.50@tcp:101:touch.500 00010000:00010000:0.0:1788652273.492942:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652273.492967:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56a00/0x340ed74ef02a76fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f083c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.493047:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56a00/0x340ed74ef02a76fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f083c expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.493064:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56a00/0x340ed74ef02a76fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f083c expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.493089:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cbe48888c00) 00010000:00010000:0.0:1788652273.493107:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788652273.493112:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e56a00, rc 0) 00000100:00100000:0.0:1788652273.493182:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe74acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+11:9671:x1875537603610240:12345-192.168.203.50@tcp:101:touch.500 Request processed in 272us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652273.493189:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 24 00010000:00010000:1.0:1788652273.493364:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a76f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.493376:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a76f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.493383:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a76f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.493391:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e57800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652273.493397:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a76f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.493418:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a76f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.493433:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cbe48888c00) 00010000:00010000:1.0:1788652273.493435:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652273.493440:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a76f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.493448:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a76f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652273.496592:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652273.496738:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603610368 00000100:00100000:1.0:1788652273.496753:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603610368 00000100:00100000:1.0:1788652273.497036:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:1.0:1788652273.497048:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe74ace680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2345:x1875537603610368:12345-192.168.203.50@tcp:8:touch.500 00010000:00080000:1.0:1788652273.497095:0:8297:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:1.0:1788652273.497141:0:8297:0:(genops.c:1385:class_connect()) connect: client 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c, cookie 0x340ed74ef02a7703 00002000:00100000:1.0:1788652273.497157:0:8297:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c/ffff8cbe513ac800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788652273.497170:0:8297:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788652273.497574:0:8297:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788652273.497615:0:8297:0:(import.c:65:import_set_state_nolock()) ffff8cbe513af000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788652273.498131:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe74ace680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2345:x1875537603610368:12345-192.168.203.50@tcp:8:touch.500 Request processed in 1081us (1548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652273.498143:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:3.0:1788652273.501440:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652273.502070:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603610496 00000100:00100000:2.0:1788652273.502086:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603610496 00000100:00100000:2.0:1788652273.502225:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:2.0:1788652273.502238:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe43648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:0:x1875537603610496:12345-192.168.203.50@tcp:2:touch.500 00000100:00080000:3.0:1788652273.507445:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1788652273.535648:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c 00000001:00080000:0.0:1788652273.535675:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1788652273.536045:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe43648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:0:x1875537603610496:12345-192.168.203.50@tcp:2:touch.500 Request processed in 33802us (34608us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788652273.536061:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:3.0:1788652273.538961:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652273.539088:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603610752 00000100:00100000:1.0:1788652273.539103:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603610752 00000100:00100000:1.0:1788652273.539177:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:1.0:1788652273.539208:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4364b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+10:9671:x1875537603610752:12345-192.168.203.50@tcp:35:touch.500 00000100:00100000:1.0:1788652273.539998:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4364b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+11:9671:x1875537603610752:12345-192.168.203.50@tcp:35:touch.500 Request processed in 789us (1045us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788652273.540009:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:2.0:1788652273.549986:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652273.550127:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603610880 00000100:00100000:1.0:1788652273.550141:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603610880 00000100:00100000:1.0:1788652273.550212:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 25 00000100:00100000:1.0:1788652273.550226:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+11:9672:x1875537603610880:12345-192.168.203.50@tcp:101:rm.0 00010000:00010000:1.0:1788652273.550261:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652273.550289:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925e00/0x340ed74ef02a770a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0843 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.550377:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a7711 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.550394:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a7711 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.550409:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a7711 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652273.550535:0:6701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788652273.550540:0:6701:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788652273.550646:0:6701:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a7711 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.550682:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925e00/0x340ed74ef02a770a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0843 expref: 13 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.550740:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a7711 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0843 expref: 12 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.550750:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cbe485ac900) 00010000:00010000:1.0:1788652273.550753:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788652273.550757:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe52925c00, rc 0) 00000100:00100000:1.0:1788652273.550884:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+12:9672:x1875537603610880:12345-192.168.203.50@tcp:101:rm.0 Request processed in 661us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652273.550893:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 25 00000100:00100000:0.0:1788652273.554717:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652273.554822:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603611136 00000100:00100000:3.0:1788652273.554837:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603611136 00000100:00100000:2.0:1788652273.555096:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 26 00000100:00100000:2.0:1788652273.555110:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+12:9672:x1875537603611136:12345-192.168.203.50@tcp:101:rm.0 00010000:00010000:2.0:1788652273.555139:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652273.555165:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7718 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f084a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652273.555298:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788652273.555525:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7718 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f084a expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.555543:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe485ac800) 00010000:00010000:2.0:1788652273.555546:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788652273.555554:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7718 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f084a expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.555572:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe40031a00, rc 0) 00000100:00100000:2.0:1788652273.555659:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+13:9672:x1875537603611136:12345-192.168.203.50@tcp:101:rm.0 Request processed in 552us (953us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1788652273.555667:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 26 00000100:00100000:3.0:1788652273.559699:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652273.560236:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603611264 00000100:00100000:0.0:1788652273.560253:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603611264 00000100:00100000:0.0:1788652273.560353:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:0.0:1788652273.560366:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe43648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+13:9672:x1875537603611264:12345-192.168.203.50@tcp:37:rm.0 00000100:00100000:2.0:1788652273.566575:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe43648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+13:9672:x1875537603611264:12345-192.168.203.50@tcp:37:rm.0 Request processed in 6198us (6873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652273.566593:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:3.0:1788652273.571164:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652273.571392:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603611520 00000100:00100000:1.0:1788652273.571408:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603611520 00000100:00100000:1.0:1788652273.571500:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:1.0:1788652273.571513:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe47b4a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+13:9672:x1875537603611520:12345-192.168.203.50@tcp:35:rm.0 00000100:00100000:1.0:1788652273.572201:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe47b4a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+14:9672:x1875537603611520:12345-192.168.203.50@tcp:35:rm.0 Request processed in 686us (1044us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788652273.572214:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:3.0:1788652273.576185:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652273.576322:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603611776 00000100:00100000:0.0:1788652273.576337:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603611776 00000100:00100000:0.0:1788652273.576415:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 27 00000100:00100000:0.0:1788652273.576426:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe43648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+14:9672:x1875537603611776:12345-192.168.203.50@tcp:101:rm.0 00010000:00010000:0.0:1788652273.576459:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652273.576666:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a7726 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0851 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.576973:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a772d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.576994:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a772d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.577078:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a772d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652273.577112:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788652273.577657:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a7726 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0851 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.577685:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a772d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0851 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.577696:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cbe485ac900) 00010000:00010000:0.0:1788652273.577699:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788652273.577704:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e56e00, rc 0) 00000100:00100000:0.0:1788652273.578056:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe43648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+16:9672:x1875537603611776:12345-192.168.203.50@tcp:101:rm.0 Request processed in 1630us (1880us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788652273.578067:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 27 00000100:00100000:0.0:1788652273.581100:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652273.581256:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603611904 00000100:00100000:2.0:1788652273.581270:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603611904 00000100:00100000:2.0:1788652273.581340:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 28 00000100:00100000:2.0:1788652273.581352:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+16:9672:x1875537603611904:12345-192.168.203.50@tcp:41:rm.0 00000004:00000024:2.0:1788652273.581428:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788652273.581530:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+16:9672:x1875537603611904:12345-192.168.203.50@tcp:41:rm.0 Request processed in 179us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652273.581537:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 28 00000100:00100000:3.0:1788652273.584041:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652273.584128:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603612032 00000100:00100000:1.0:1788652273.584141:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603612032 00000100:00100000:1.0:1788652273.584210:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 29 00000100:00100000:1.0:1788652273.584220:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe43649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+16:9672:x1875537603612032:12345-192.168.203.50@tcp:101:rm.0 00010000:00010000:1.0:1788652273.584247:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652273.584275:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925e00/0x340ed74ef02a773b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0858 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.584365:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925000/0x340ed74ef02a7742 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.584399:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925000/0x340ed74ef02a7742 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.584414:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925000/0x340ed74ef02a7742 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.584434:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925600/0x340ed74ef02a7749 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.584442:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925600/0x340ed74ef02a7749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.584450:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925600/0x340ed74ef02a7749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.584593:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925200/0x340ed74ef02a7750 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.584603:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925200/0x340ed74ef02a7750 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.584610:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925200/0x340ed74ef02a7750 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652273.584642:0:6701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788652273.584647:0:6701:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788652273.584669:0:6701:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925200/0x340ed74ef02a7750 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.584682:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925200/0x340ed74ef02a7750 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.584701:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925000/0x340ed74ef02a7742 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.584708:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925000/0x340ed74ef02a7742 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.584716:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925000/0x340ed74ef02a7742 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.584722:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe52925000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652273.584996:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925000/0x340ed74ef02a7742 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.585008:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925000/0x340ed74ef02a7742 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.585025:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cbe485ac900) 00010000:00010000:1.0:1788652273.585028:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652273.585035:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925000/0x340ed74ef02a7742 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.585042:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925000/0x340ed74ef02a7742 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.585058:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925600/0x340ed74ef02a7749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.585065:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925600/0x340ed74ef02a7749 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.585071:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925600/0x340ed74ef02a7749 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.585083:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe52925600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652273.585086:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925600/0x340ed74ef02a7749 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.585093:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925600/0x340ed74ef02a7749 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.585101:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x7eaa65ec (ffff8cbe48da0400) 00010000:00010000:1.0:1788652273.585104:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652273.585106:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925600/0x340ed74ef02a7749 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.585113:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925600/0x340ed74ef02a7749 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.585152:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925e00/0x340ed74ef02a773b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0858 expref: 18 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.585168:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925200/0x340ed74ef02a7750 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0858 expref: 17 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.585176:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cbe48888c00) 00010000:00010000:1.0:1788652273.585179:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788652273.585182:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe52925200, rc 0) 00000100:00100000:1.0:1788652273.585300:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe43649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+17:9672:x1875537603612032:12345-192.168.203.50@tcp:101:rm.0 Request processed in 1080us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652273.585308:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 29 00000100:00100000:2.0:1788652273.589193:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652273.589277:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603612288 00000100:00100000:3.0:1788652273.589302:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603612288 00000100:00100000:3.0:1788652273.589374:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 30 00000100:00100000:3.0:1788652273.589388:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+17:9672:x1875537603612288:12345-192.168.203.50@tcp:36:rm.0 00010000:00010000:3.0:1788652273.589494:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788652273.589528:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925200/0x340ed74ef02a7750 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0858 expref: 17 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.589553:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56a00/0x340ed74ef02a76fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f083c expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.589567:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cbe48888c00) 00010000:00010000:3.0:1788652273.589584:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a7711 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0843 expref: 15 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.589593:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cbe485ac900) 00010000:00010000:3.0:1788652273.589597:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788652273.589624:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7757 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.589641:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7757 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.589652:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7757 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.589670:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a775e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.589678:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a775e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.589684:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a775e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.589926:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7765 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.589935:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7765 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.589943:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7765 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788652273.590844:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788652273.590860:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 290574087253ns, next at 291574084301ns, rc = 0 00010000:00010000:3.0:1788652273.590936:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a776c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.590951:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a776c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.590961:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a776c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.590970:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a776c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.590976:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a776c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.590983:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a776c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.591011:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652273.591040:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7765 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.591055:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7765 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.591061:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7765 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.591068:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652273.591073:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7765 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.591083:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7765 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.591095:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cbe7fde3400) 00010000:00010000:3.0:1788652273.591098:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788652273.591104:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7765 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.591110:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7765 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.591131:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7757 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.591137:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7757 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.591143:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7757 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.591148:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652273.591156:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7757 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.591164:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7757 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.591173:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cbe485ac900) 00010000:00010000:3.0:1788652273.591176:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652273.591179:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7757 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.591186:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7757 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788652273.591197:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ea5560e reply state 00000000a06ae5e0 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a775e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652273.591207:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788652273.591331:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+16:9672:x1875537603612288:12345-192.168.203.50@tcp:36:rm.0 Request processed in 1942us (2147us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788652273.591342:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 30 00010000:00010000:0.0:1788652273.592579:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652273.592594:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a776c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.592605:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4a00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:0.0:1788652273.592608:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a776c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.592618:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a776c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.592637:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cbe7fde3400) 00010000:00010000:0.0:1788652273.592640:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788652273.592645:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a776c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.592666:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a776c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.592695:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652273.592697:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652273.592698:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652273.595296:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652273.595940:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603612544 00000100:00100000:2.0:1788652273.595956:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603612544 00000100:00100000:2.0:1788652273.596037:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:2.0:1788652273.596065:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+16:9672:x1875537603612544:12345-192.168.203.50@tcp:35:rm.0 00000100:00100000:2.0:1788652273.596395:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+17:9672:x1875537603612544:12345-192.168.203.50@tcp:35:rm.0 Request processed in 331us (1113us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788652273.596404:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:3.0:1788652273.598661:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652273.598755:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603612800 00000100:00100000:0.0:1788652273.598767:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603612800 00000100:00100000:0.0:1788652273.598861:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 31 00000100:00100000:0.0:1788652273.598872:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4364a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+17:9672:x1875537603612800:12345-192.168.203.50@tcp:36:rm.0 00010000:00010000:0.0:1788652273.598948:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788652273.598985:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a772d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0851 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.599011:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a76cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f082e expref: 16 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.599025:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cbe485ac900) 00010000:00010000:0.0:1788652273.599045:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a768c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0820 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.599053:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe485ac800) 00010000:00010000:0.0:1788652273.599060:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788652273.599093:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57c00/0x340ed74ef02a7773 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.599109:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57c00/0x340ed74ef02a7773 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.599135:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57c00/0x340ed74ef02a7773 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.599151:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a777a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.599158:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a777a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.599165:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a777a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.599524:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a7781 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.599534:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a7781 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.599542:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a7781 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652273.600267:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788652273.600291:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a7781 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.600299:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a7781 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.600306:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a7781 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.600313:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e56800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652273.600324:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a7781 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.600334:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a7781 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.600347:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:0.0:1788652273.600351:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788652273.600356:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a7781 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.600364:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a7781 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.600388:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57c00/0x340ed74ef02a7773 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.600395:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57c00/0x340ed74ef02a7773 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.600401:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57c00/0x340ed74ef02a7773 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.600406:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e57c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652273.600408:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57c00/0x340ed74ef02a7773 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.600415:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57c00/0x340ed74ef02a7773 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.600422:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe48888200) 00010000:00010000:0.0:1788652273.600425:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652273.600437:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57c00/0x340ed74ef02a7773 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652273.600443:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57c00/0x340ed74ef02a7773 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788652273.600458:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049a072d8 reply state 000000002205b8dc transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a777a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652273.600467:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788652273.600576:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4364a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+16:9672:x1875537603612800:12345-192.168.203.50@tcp:36:rm.0 Request processed in 1702us (1922us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788652273.600586:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 31 00010000:00010000:1.0:1788652273.604274:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a775e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.604322:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a775e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.604332:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a775e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.604339:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652273.604346:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a775e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.604355:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a775e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.604377:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x7eaa65ec (ffff8cbe7fde3200) 00010000:00010000:1.0:1788652273.604381:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652273.604387:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a775e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652273.604396:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a775e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.607071:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a777a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.607093:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a777a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.607102:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a777a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.607110:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e57800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652273.607135:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a777a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.607148:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a777a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.607168:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cbe48888600) 00010000:00010000:3.0:1788652273.607171:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652273.607177:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a777a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652273.607185:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57800/0x340ed74ef02a777a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652273.928025:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652274.960086:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652275.975909:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652276.365159:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4364b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627762048:0@lo:400:kworker.0 00000100:00100000:1.0:1788652276.365229:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652276.367325:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788652276.367349:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe43649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627762432:0@lo:400:kworker.0 00000100:00100000:1.0:1788652276.367422:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652276.367738:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4364ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627762176:0@lo:400:kworker.0 00000100:00100000:2.0:1788652276.367803:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652276.367836:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788652276.367842:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4364b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627762304:0@lo:400:kworker.0 00000100:00100000:2.0:1788652276.367865:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652276.367895:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627762432 00000100:00100000:2.0:1788652276.367904:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627762432 00000100:00100000:2.0:1788652276.367964:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788652276.367974:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627762432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652276.368028:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627762432:12345-0@lo:400:kworker.0 Request processed in 57us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652276.368035:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788652276.368057:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627762176 00000100:00100000:2.0:1788652276.368061:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627762176 00000100:00100000:2.0:1788652276.368083:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627762304 00000100:00100000:2.0:1788652276.368085:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627762304 00000100:00100000:2.0:1788652276.368102:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788652276.368107:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627762176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652276.368135:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627762176:12345-0@lo:400:kworker.0 Request processed in 28us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652276.368140:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788652276.368161:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788652276.368166:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627762304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652276.368189:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627762304:12345-0@lo:400:kworker.0 Request processed in 23us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652276.368194:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:2.0:1788652276.368238:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe43649500 x1875537627762432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652276.368251:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe43649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627762432:0@lo:400:kworker.0 00000100:00100000:2.0:1788652276.368279:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4364b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627762304:0@lo:400:kworker.0 00000100:00100000:2.0:1788652276.368288:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4364ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627762176:0@lo:400:kworker.0 00000100:00100000:3.0:1788652276.368532:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788652276.368542:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4364bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627762560:0@lo:400:kworker.0 00000100:00100000:3.0:1788652276.368571:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788652276.368596:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788652276.368601:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788652276.368608:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627762560 00000100:00100000:3.0:1788652276.368611:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627762560 00000100:00100000:3.0:1788652276.368638:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788652276.368644:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe43649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627762560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652276.368676:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe43649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627762560:12345-0@lo:400:kworker.0 Request processed in 31us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652276.368683:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1788652276.368696:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788652276.368810:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4364aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627762688:0@lo:400:kworker.0 00000100:00100000:1.0:1788652276.368838:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652276.368877:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627762688 00000100:00100000:1.0:1788652276.368880:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627762688 00000100:00100000:1.0:1788652276.368909:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788652276.368916:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627762688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652276.368949:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627762688:12345-0@lo:400:kworker.0 Request processed in 34us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652276.368956:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1788652276.368980:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe4364aa00 x1875537627762688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652276.368989:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4364aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627762688:0@lo:400:kworker.0 00000100:00100000:1.0:1788652276.370515:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627762048 00000100:00100000:1.0:1788652276.370530:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627762048 00000100:00100000:1.0:1788652276.370587:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788652276.370596:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:3306:x1875537627762048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652276.370667:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:3306:x1875537627762048:12345-0@lo:400:kworker.0 Request processed in 72us (5440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652276.370674:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788652276.370788:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4364bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627762560:0@lo:400:kworker.0 00000100:00080000:3.0:1788652276.370820:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788652276.370916:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4364b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627762048:0@lo:400:kworker.0 00000100:00100000:3.0:1788652276.407101:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652276.407165:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652276.407195:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652276.407221:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652276.407252:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603613056 00000100:00100000:3.0:1788652276.407262:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603613056 00000100:00100000:3.0:1788652276.407317:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603613312 00000100:00100000:3.0:1788652276.407321:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603613312 00000100:00100000:3.0:1788652276.407343:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 95 00000100:00100000:3.0:1788652276.407354:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe43649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+14:2348:x1875537603613056:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1788652276.407432:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe43649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+14:2348:x1875537603613056:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 80us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652276.407439:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 95 00000100:00100000:3.0:1788652276.407456:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 96 00000100:00100000:3.0:1788652276.407462:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe43649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2348:x1875537603613312:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1788652276.407486:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe43649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2348:x1875537603613312:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 24us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652276.407493:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 96 00000100:00080000:3.0:1788652276.407510:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652276.407655:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603612928 00000100:00100000:2.0:1788652276.407659:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603612928 00000100:00100000:2.0:1788652276.407696:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 247 00000100:00100000:2.0:1788652276.407703:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2348:x1875537603612928:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652276.407747:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2348:x1875537603612928:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 45us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652276.407755:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 247 00000100:00100000:1.0:1788652276.408231:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603613184 00000100:00100000:1.0:1788652276.408237:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603613184 00000100:00100000:1.0:1788652276.408289:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 56 00000100:00100000:1.0:1788652276.408297:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4364bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2348:x1875537603613184:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652276.408331:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4364bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2348:x1875537603613184:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 35us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652276.408338:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 56 00000100:00080000:3.0:1788652276.408497:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788652276.872146:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b04df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627762816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788652276.872218:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652276.872458:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627762816 00000100:00100000:1.0:1788652276.872466:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627762816 00000100:00100000:1.0:1788652276.872548:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788652276.872558:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627762816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788652276.872596:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788652276.875911:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627762816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3341us (3679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652276.875926:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788652276.881338:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe4b04df80 x1875537627762816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652276.881367:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b04df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627762816:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788652277.002391:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788652277.896559:0:6800:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 294879783958ns, next at 295879781033ns, rc = 0 00000100:00100000:2.0:1788652277.896659:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788652277.896679:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe43648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627762944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788652277.896762:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652277.896983:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627762944 00000100:00100000:3.0:1788652277.896990:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627762944 00000100:00100000:3.0:1788652277.897039:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788652277.897048:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627762944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788652277.897082:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652277.897134:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627762944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652277.897155:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1788652277.897386:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe43648a80 x1875537627762944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652277.897405:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe43648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627762944:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788652277.971560:0:11601:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1788652278.025221:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788652278.456885:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1788652278.456922:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:2.0:1788652278.456943:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788652278.457167:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4364a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627763072:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788652278.457235:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652278.461034:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627763072 00000100:00100000:1.0:1788652278.461050:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627763072 00000100:00080000:3.0:1788652278.462217:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788652278.462745:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788652278.462759:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627763072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788652278.462820:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1788652278.462903:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9caaf0, atime: 0x6a9caaf0, ctime: 0x6a9caaf0, blocks: 0x1 00010000:00010000:1.0:1788652278.462911:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000645f7acb/0x340ed74ef02a7788 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652278.462929:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=295s v=(0 0) 00010000:00010000:1.0:1788652278.462934:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652278.462941:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000645f7acb/0x340ed74ef02a7788 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652278.462960:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000645f7acb/0x340ed74ef02a7788 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652278.462970:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000645f7acb/0x340ed74ef02a7788 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652278.462978:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000645f7acb/0x340ed74ef02a7788 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652278.463004:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652278.463317:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652278.463326:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000645f7acb/0x340ed74ef02a7788 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652278.463334:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe52925000 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:0.0:1788652278.463339:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000645f7acb/0x340ed74ef02a7788 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652278.463515:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000645f7acb/0x340ed74ef02a7788 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652278.463547:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000645f7acb/0x340ed74ef02a7788 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652278.463556:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000645f7acb/0x340ed74ef02a7788 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652278.463575:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652278.463577:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652278.463579:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652278.464678:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875537627763072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1919us (7437us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788652278.464689:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1788652278.464940:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cbe4364a300/2, rc 0, transno 4294967300 00000100:00100000:2.0:1788652278.464948:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4364a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627763072:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1788652279.024054:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1788652279.048040:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788652279.086099:0:11651:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff2cb537e0 20000000:00000080:0.0:1788652279.086121:0:11651:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cbe7f176c00 uarg=0000000000000000 20000000:01000000:0.0:1788652279.086158:0:11651:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788652279.086165:0:11651:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788652279.086170:0:11651:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788652279.089398:0:11652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788652279.089654:0:11651:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788652279.095645:0:11651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788652279.095717:0:11651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788652279.096158:0:11651:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788652279.096181:0:11651:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788652279.096202:0:11651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbe40031a00/0x340ed74ef02a778f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.096224:0:11651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe52924e00/0x340ed74ef02a762a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f080b expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.096232:0:11651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe7a0e5400/0x340ed74ef02a7638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a7631 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.096239:0:11651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe7a0e4c00/0x340ed74ef02a7646 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a763f expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.096313:0:11651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe8215e200/0x340ed74ef02a7654 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a764d expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.096331:0:11651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe7a0e5200/0x340ed74ef02a765b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0812 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.096340:0:11651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbe40031a00/0x340ed74ef02a778f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.096379:0:11651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe7a0e5200/0x340ed74ef02a765b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0812 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.096396:0:11651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe7a0e5200/0x340ed74ef02a765b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0812 expref: 12 pid: 5829 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652279.096411:0:11651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a406d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1875537627763200:192.168.203.50@tcp:104: 00010000:00010000:2.0:1788652279.096583:0:11651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe8215e200/0x340ed74ef02a7654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a764d expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.096591:0:11651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe8215e200/0x340ed74ef02a7654 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a764d expref: 18 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652279.096601:0:11651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1875537627763328:0@lo:104: 00000100:00100000:2.0:1788652279.096642:0:11651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788652279.096682:0:11651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe7a0e4c00/0x340ed74ef02a7646 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a763f expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.096703:0:11651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe7a0e4c00/0x340ed74ef02a7646 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a763f expref: 18 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652279.096711:0:11651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1875537627763456:0@lo:104: 00000100:00100000:2.0:1788652279.096741:0:11651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788652279.096789:0:11651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe7a0e5400/0x340ed74ef02a7638 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a7631 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.096798:0:11651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cbe7a0e5400/0x340ed74ef02a7638 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a7631 expref: 18 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652279.096807:0:11651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1875537627763584:0@lo:104: 00000100:00100000:2.0:1788652279.096831:0:11651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652279.096875:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788652279.096887:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627763328 00000100:00100000:2.0:1788652279.096893:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627763328 00000100:00100000:2.0:1788652279.096929:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627763456 00000100:00100000:2.0:1788652279.096932:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627763456 00000100:00100000:2.0:1788652279.096941:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627763584 00000100:00100000:2.0:1788652279.096943:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627763584 00000100:00100000:2.0:1788652279.096954:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788652279.096961:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a406a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f811a652-691e-4a40-b660-977a4758dd08+5:11651:x1875537627763328:12345-0@lo:104: 00010000:00010000:2.0:1788652279.096974:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a764d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a7654 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.097018:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788652279.097025:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a406a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f811a652-691e-4a40-b660-977a4758dd08+5:11651:x1875537627763328:12345-0@lo:104: Request processed in 64us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652279.097033:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788652279.097050:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788652279.097056:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f811a652-691e-4a40-b660-977a4758dd08+4:11651:x1875537627763456:12345-0@lo:104: 00010000:00010000:2.0:1788652279.097063:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e400/0x340ed74ef02a763f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a7646 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.097106:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788652279.097112:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f811a652-691e-4a40-b660-977a4758dd08+4:11651:x1875537627763456:12345-0@lo:104: Request processed in 57us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652279.097118:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788652279.097130:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788652279.097136:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f811a652-691e-4a40-b660-977a4758dd08+3:11651:x1875537627763584:12345-0@lo:104: 00010000:00010000:2.0:1788652279.097143:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe52924400/0x340ed74ef02a7631 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a7638 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.097169:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788652279.097174:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f811a652-691e-4a40-b660-977a4758dd08+3:11651:x1875537627763584:12345-0@lo:104: Request processed in 39us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652279.097179:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1788652279.097217:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788652279.097223:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a764d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a7654 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.097229:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4200 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:2.0:1788652279.097233:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a764d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a7654 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.097242:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a764d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a7654 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652279.097315:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a764d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a7654 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652279.097320:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788652279.097355:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a764d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7654 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.097361:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652279.097378:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a764d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7654 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.097384:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a764d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7654 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.097395:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788652279.097398:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e400/0x340ed74ef02a763f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a7646 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.097404:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e400 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:2.0:1788652279.097407:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e400/0x340ed74ef02a763f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a7646 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.097413:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e400/0x340ed74ef02a763f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a7646 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652279.097419:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e400/0x340ed74ef02a763f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a7646 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652279.097424:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788652279.097434:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e400/0x340ed74ef02a763f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7646 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.097439:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652279.097444:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e400/0x340ed74ef02a763f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7646 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.097459:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e400/0x340ed74ef02a763f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7646 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.097469:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652279.097472:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe52924400/0x340ed74ef02a7631 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a7638 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.097477:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe52924400 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:2.0:1788652279.097479:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe52924400/0x340ed74ef02a7631 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a7638 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.097485:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe52924400/0x340ed74ef02a7631 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a7638 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652279.097490:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe52924400/0x340ed74ef02a7631 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a7638 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652279.097494:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788652279.097507:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe52924400/0x340ed74ef02a7631 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7638 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.097512:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652279.097526:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe52924400/0x340ed74ef02a7631 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7638 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.097532:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe52924400/0x340ed74ef02a7631 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a7638 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.097544:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652279.097551:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652279.097553:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652279.097560:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652279.097574:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627763712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652279.097603:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652279.097627:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788652279.097633:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627763840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652279.097652:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652279.097681:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627763968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652279.097715:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652279.097747:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627763712 00000100:00100000:2.0:1788652279.097751:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627763712 00010000:00010000:2.0:1788652279.097769:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe8215e200/0x340ed74ef02a7654 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a764d expref: 19 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652279.097819:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627763840 00000100:00100000:2.0:1788652279.097821:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627763840 00010000:00010000:2.0:1788652279.097834:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe7a0e4c00/0x340ed74ef02a7646 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a763f expref: 20 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652279.097843:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627763968 00000100:00100000:2.0:1788652279.097846:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627763968 00010000:00010000:2.0:1788652279.097854:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe7a0e5400/0x340ed74ef02a7638 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a7631 expref: 21 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652279.097866:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788652279.097871:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+21:3303:x1875537627763712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788652279.097881:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652279.097885:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe8215e200/0x340ed74ef02a7654 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a764d expref: 21 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.097901:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe8215e200/0x340ed74ef02a7654 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a764d expref: 21 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.097919:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652279.097949:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+21:3303:x1875537627763712:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652279.097956:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788652279.097969:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788652279.097976:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+20:3303:x1875537627763840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788652279.097984:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652279.097988:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe7a0e4c00/0x340ed74ef02a7646 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a763f expref: 20 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.097996:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe7a0e4c00/0x340ed74ef02a7646 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a763f expref: 20 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.098005:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652279.098026:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+20:3303:x1875537627763840:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652279.098031:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788652279.098043:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788652279.098048:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51233c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+19:3305:x1875537627763968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788652279.098054:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652279.098058:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe7a0e5400/0x340ed74ef02a7638 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a7631 expref: 19 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.098065:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe7a0e5400/0x340ed74ef02a7638 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a7631 expref: 19 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.098081:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652279.098107:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51233c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f811a652-691e-4a40-b660-977a4758dd08+19:3305:x1875537627763968:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652279.098113:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788652279.098168:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627763968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652279.098191:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627763840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652279.098198:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627763712:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788652279.098232:0:11651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe52924e00/0x340ed74ef02a762a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f080b expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.098254:0:11651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe52924e00/0x340ed74ef02a762a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f080b expref: 12 pid: 5829 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652279.098266:0:11651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1875537627764096:192.168.203.50@tcp:104: 00000100:00100000:2.0:1788652279.098302:0:11651:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5eb13600 going to sleep for 11 seconds 00010000:00010000:2.0:1788652279.098315:0:11651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe8215e200/0x340ed74ef02a7654 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a764d expref: 18 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652279.098325:0:11651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a407b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1875537627763328:0@lo:104: 00010000:00010000:2.0:1788652279.098335:0:11651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe7a0e4c00/0x340ed74ef02a7646 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a763f expref: 17 pid: 5829 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652279.098343:0:11651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1875537627763456:0@lo:104: 00010000:00010000:2.0:1788652279.098353:0:11651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe7a0e5400/0x340ed74ef02a7638 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a7631 expref: 16 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652279.098372:0:11651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1875537627763584:0@lo:104: 00000100:00100000:0.0:1788652279.101333:0:11651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a406d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1875537627763200:192.168.203.50@tcp:104: 00000100:00100000:3.0:1788652279.102083:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652279.102298:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603613440 00000100:00100000:2.0:1788652279.102307:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603613440 00010000:00010000:2.0:1788652279.102344:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe7a0e5200/0x340ed74ef02a765b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0812 expref: 13 pid: 5829 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652279.102416:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 33 00000100:00100000:2.0:1788652279.102425:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe43648700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2347:x1875537603613440:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652279.102439:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652279.102445:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe7a0e5200/0x340ed74ef02a765b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0812 expref: 13 pid: 5829 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.102457:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe7a0e5200/0x340ed74ef02a765b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0812 expref: 13 pid: 5829 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.102475:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe7a0e5200/0x340ed74ef02a765b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0812 expref: 13 pid: 5829 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.102491:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652279.102575:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe43648700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+12:2347:x1875537603613440:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 149us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652279.102582:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 33 00000100:00100000:2.0:1788652279.104832:0:11651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11651:1875537627764096:192.168.203.50@tcp:104: 00010000:00010000:2.0:1788652279.104951:0:11651:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbe40031a00/0x340ed74ef02a778f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652279.105522:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652279.105573:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603613568 00000100:00100000:2.0:1788652279.105595:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603613568 00010000:00010000:2.0:1788652279.105629:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe52924e00/0x340ed74ef02a762a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f080b expref: 12 pid: 5829 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652279.105670:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 34 00000100:00100000:2.0:1788652279.105680:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe43648a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+12:2346:x1875537603613568:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652279.105703:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652279.105709:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe52924e00/0x340ed74ef02a762a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f080b expref: 12 pid: 5829 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.105725:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe52924e00/0x340ed74ef02a762a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f080b expref: 12 pid: 5829 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.105743:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe52924e00/0x340ed74ef02a762a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f080b expref: 12 pid: 5829 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.105760:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbe40031a00/0x340ed74ef02a778f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.105799:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe40031a00/0x340ed74ef02a778f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.105818:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe40031a00/0x340ed74ef02a778f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.105825:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe40031a00/0x340ed74ef02a778f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.105832:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbe40031a00/0x340ed74ef02a778f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.105863:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbe40031a00/0x340ed74ef02a778f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.105870:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe40031a00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652279.105874:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbe40031a00/0x340ed74ef02a778f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.105883:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbe40031a00/0x340ed74ef02a778f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.105900:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbe40031a00/0x340ed74ef02a778f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652279.105911:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652279.105964:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe43648a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+11:2346:x1875537603613568:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 285us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652279.105973:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 34 00010000:00010000:0.0:1788652279.106149:0:11651:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbe40031a00/0x340ed74ef02a778f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652279.106158:0:11651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbe40031a00/0x340ed74ef02a778f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652279.106164:0:11651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe40031a00/0x340ed74ef02a778f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652280.072007:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788652280.584102:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788652280.584111:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe7fdf4800 from 7 10000000:01000000:2.0:1788652280.584117:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788652280.584171:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe40031000/0x340ed74ef02a7796 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652280.584183:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe40031000/0x340ed74ef02a7796 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652280.584194:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe40031000/0x340ed74ef02a7796 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652280.584249:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627764224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788652280.584319:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652280.584400:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5eb13600 going to sleep for 11 seconds 00000100:00100000:1.0:1788652280.584761:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627764224 00000100:00100000:1.0:1788652280.584790:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627764224 00000100:00100000:1.0:1788652280.584845:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788652280.584854:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+16:5832:x1875537627764224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788652280.584865:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652280.584880:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a779d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a7796 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652280.584901:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a779d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a7796 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652280.584910:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a779d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a7796 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652280.584918:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe52925e00, rc 0) 00000100:00100000:1.0:1788652280.584965:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627764224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652280.584972:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788652280.585069:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627764224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652280.585083:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe40031000/0x340ed74ef02a7796 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a779d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652280.585093:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe40031000/0x340ed74ef02a7796 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a779d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652280.585150:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4364b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627764352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652280.585178:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652280.585213:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5138cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788652280.586401:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627764352 00000100:00100000:2.0:1788652280.586411:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627764352 00000100:00100000:2.0:1788652280.586471:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788652280.586479:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627764352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788652280.586979:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627764352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 500us (1799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652280.586988:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788652280.587481:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4364b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627764352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788652280.587532:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a0c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627764480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788652280.587578:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652280.587657:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe49d2cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788652280.587706:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627764480 00000100:00100000:1.0:1788652280.587712:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627764480 00000100:00100000:1.0:1788652280.587839:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788652280.587848:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627764480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788652280.588004:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627764480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652280.588011:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788652280.588091:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a0c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627764480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788652280.588479:0:11665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a0c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:11665:1875537627764608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788652280.588516:0:11665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652280.588656:0:11665:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe49d2c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788652280.588841:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627764608 00000100:00100000:2.0:1788652280.588846:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627764608 00000100:00100000:2.0:1788652280.588873:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788652280.588880:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+17:11665:x1875537627764608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652280.589038:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+17:11665:x1875537627764608:12345-0@lo:502:llog_process_th.0 Request processed in 157us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652280.589045:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788652280.589127:0:11665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a0c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:11665:1875537627764608:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788652280.589152:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788652280.589162:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652280.589165:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788652280.589171:0:11665:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbe7fdf4800 00000020:00000080:0.0:1788652280.589174:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788652280.589377:0:11665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a0c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:11665:1875537627764736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788652280.589414:0:11665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652280.589436:0:11665:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe49d2c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788652280.590701:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627764736 00000100:00100000:0.0:1788652280.590710:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627764736 00000100:00100000:0.0:1788652280.590743:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788652280.590751:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+17:11665:x1875537627764736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788652280.590998:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+17:11665:x1875537627764736:12345-0@lo:502:llog_process_th.0 Request processed in 247us (1582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652280.591005:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788652280.591063:0:11665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a0c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:11665:1875537627764736:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788652280.591097:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788652280.591104:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652280.591106:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788652280.591110:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788652280.592104:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788652280.592129:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788652280.592138:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe40031000/0x340ed74ef02a7796 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a779d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652280.592150:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe40031000/0x340ed74ef02a7796 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a779d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652280.592160:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788652280.592163:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe818bc800 from 7 10000000:01000000:0.0:1788652280.592166:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788652280.592195:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57400/0x340ed74ef02a77a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652280.592214:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57400/0x340ed74ef02a77a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652280.592224:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57400/0x340ed74ef02a77a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652280.592245:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a0c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627764864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788652280.592289:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652280.592324:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe49d2c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788652280.592339:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627764864 00000100:00100000:0.0:1788652280.592344:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627764864 00000100:00100000:0.0:1788652280.592377:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788652280.592384:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+17:5832:x1875537627764864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652280.592395:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652280.592406:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe49e56a00/0x340ed74ef02a77ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a77a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652280.592427:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe49e56a00/0x340ed74ef02a77ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a77a4 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652280.592439:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe49e56a00/0x340ed74ef02a77ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a77a4 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652280.592447:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e56a00, rc 0) 00000100:00100000:0.0:1788652280.592476:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627764864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652280.592482:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788652280.592514:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a0c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627764864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652280.592525:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57400/0x340ed74ef02a77a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a77ab expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652280.592533:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57400/0x340ed74ef02a77a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a77ab expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652280.592573:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a0c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627764992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788652280.592596:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652280.592609:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe49d2c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788652280.592619:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627764992 00000100:00100000:0.0:1788652280.592622:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627764992 00000100:00100000:0.0:1788652280.592646:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788652280.592651:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627764992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788652280.595080:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627764992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2421us (2475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652280.595093:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788652280.595161:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a0c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627764992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788652280.595421:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a0c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627765120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788652280.595467:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652280.595498:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe49d2c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788652280.595514:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627765120 00000100:00100000:0.0:1788652280.595519:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627765120 00000100:00100000:0.0:1788652280.595547:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788652280.595554:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627765120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788652280.595707:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627765120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652280.595714:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788652280.595752:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a0c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627765120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788652280.595991:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a0c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:11667:1875537627765248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788652280.596025:0:11667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652280.596044:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627765248 00000100:00100000:0.0:1788652280.596048:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627765248 00000100:00100000:0.0:1788652280.596067:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788652280.596073:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+18:11667:x1875537627765248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788652280.596190:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+18:11667:x1875537627765248:12345-0@lo:502:llog_process_th.0 Request processed in 117us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652280.596214:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788652280.596239:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe49d2cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788652280.596251:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a0c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:11667:1875537627765248:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788652280.596271:0:11667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788652280.596280:0:11667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652280.596283:0:11667:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788652280.596289:0:11667:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbe818bc800 00000020:00000080:0.0:1788652280.596291:0:11667:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788652280.596364:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a0c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:11667:1875537627765376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788652280.596392:0:11667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652280.596411:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627765376 00000100:00100000:0.0:1788652280.596414:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627765376 00000100:00100000:0.0:1788652280.596429:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788652280.596435:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+18:11667:x1875537627765376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788652280.596538:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+18:11667:x1875537627765376:12345-0@lo:502:llog_process_th.0 Request processed in 102us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652280.596545:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788652280.596570:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe49d2cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788652280.596582:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a0c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:11667:1875537627765376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788652280.596600:0:11667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788652280.596604:0:11667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652280.596606:0:11667:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788652280.596610:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788652280.596653:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788652280.596667:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788652280.596676:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57400/0x340ed74ef02a77a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a77ab expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652280.599766:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57400/0x340ed74ef02a77a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a77ab expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652280.599793:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788652280.599796:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe50c46000 from 7 10000000:01000000:0.0:1788652280.599799:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788652280.599840:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a77b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652280.599848:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a77b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652280.599858:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a77b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652280.599882:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a0c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627765504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788652280.599948:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652280.599993:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe49d2cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788652280.600024:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627765504 00000100:00100000:0.0:1788652280.600030:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627765504 00000100:00100000:0.0:1788652280.600075:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788652280.600084:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+18:5832:x1875537627765504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652280.600096:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652280.600108:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe49e57c00/0x340ed74ef02a77b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a77b2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652280.600131:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe49e57c00/0x340ed74ef02a77b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a77b2 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652280.600154:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe49e57c00/0x340ed74ef02a77b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a77b2 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652280.600162:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e57c00, rc 0) 00000100:00100000:0.0:1788652280.601435:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:5832:x1875537627765504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1344us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652280.601447:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788652280.602969:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a0c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627765504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652280.603000:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a77b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a77b9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652280.603014:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a77b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a77b9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652280.603088:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4364aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627765632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652280.603143:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652280.603179:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5138c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788652280.603328:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627765632 00000100:00100000:1.0:1788652280.603334:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627765632 00000100:00100000:1.0:1788652280.603383:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788652280.603392:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:5832:x1875537627765632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788652280.603648:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:5832:x1875537627765632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652280.603655:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788652280.603880:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4364aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627765632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788652280.603919:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627765760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788652280.603957:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652280.603981:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5eb13f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788652280.604132:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627765760 00000100:00100000:1.0:1788652280.604138:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627765760 00000100:00100000:1.0:1788652280.604173:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788652280.604180:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:5832:x1875537627765760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788652280.604350:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b110450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:5832:x1875537627765760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652280.604357:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788652280.604431:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f811a652-691e-4a40-b660-977a4758dd08:5832:1875537627765760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788652280.604895:0:11669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4364ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:11669:1875537627765888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788652280.604933:0:11669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652280.604962:0:11669:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5138cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788652280.605038:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627765888 00000100:00100000:1.0:1788652280.605042:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627765888 00000100:00100000:1.0:1788652280.605074:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788652280.605082:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+19:11669:x1875537627765888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788652280.605310:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+19:11669:x1875537627765888:12345-0@lo:502:llog_process_th.0 Request processed in 228us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652280.605316:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788652280.605387:0:11669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4364ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:11669:1875537627765888:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788652280.605410:0:11669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652280.605419:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652280.605421:0:11669:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788652280.605429:0:11669:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbe50c46000 00000020:00000080:3.0:1788652280.605431:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788652280.605509:0:11669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4364ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:11669:1875537627766016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788652280.605544:0:11669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652280.605565:0:11669:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5138cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788652280.605849:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627766016 00000100:00100000:2.0:1788652280.605854:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627766016 00000100:00100000:2.0:1788652280.605935:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788652280.605944:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:11669:x1875537627766016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652280.606084:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:11669:x1875537627766016:12345-0@lo:502:llog_process_th.0 Request processed in 141us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652280.606090:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788652280.606884:0:11669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4364ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f811a652-691e-4a40-b660-977a4758dd08:11669:1875537627766016:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788652280.606912:0:11669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652280.606918:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652280.606921:0:11669:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788652280.606925:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788652280.607086:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788652280.607103:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788652280.607113:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a77b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a77b9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652280.607123:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a77b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a77b9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788652280.619762:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788652280.819843:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652280.819942:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603613696 00000100:00100000:1.0:1788652280.819952:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603613696 00000100:00100000:1.0:1788652280.820009:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 263 00000100:00100000:1.0:1788652280.820019:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+11:5588:x1875537603613696:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788652280.820036:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652280.820055:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe52925600/0x340ed74ef02a77c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f085f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652280.820085:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe52925600/0x340ed74ef02a77c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f085f expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652280.820098:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe52925600/0x340ed74ef02a77c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f085f expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652280.820108:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe52925600, rc 0) 00000100:00100000:1.0:1788652280.820167:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+12:5588:x1875537603613696:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 Request processed in 149us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652280.820174:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 263 00000100:00100000:1.0:1788652280.826110:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652280.826202:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603613824 00000100:00100000:3.0:1788652280.826212:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603613824 00000100:00100000:3.0:1788652280.826262:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 264 00000100:00100000:3.0:1788652280.826272:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+12:5588:x1875537603613824:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652280.826556:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+12:5588:x1875537603613824:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 Request processed in 284us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652280.826564:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 264 00000100:00100000:3.0:1788652280.830549:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652280.832350:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603613952 00000100:00100000:2.0:1788652280.832363:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603613952 00000100:00100000:3.0:1788652280.832579:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 265 00000100:00100000:3.0:1788652280.832591:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+12:5588:x1875537603613952:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788652280.834576:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+12:5588:x1875537603613952:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 Request processed in 1976us (4025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652280.834592:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 265 00000100:00100000:0.0:1788652280.847245:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652280.847560:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603614080 00000100:00100000:1.0:1788652280.847571:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603614080 00000100:00100000:1.0:1788652280.847628:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 266 00000100:00100000:1.0:1788652280.847638:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+12:9942:x1875537603614080:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788652280.847913:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+12:9942:x1875537603614080:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 275us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652280.847921:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 266 00000100:00100000:1.0:1788652280.857723:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652280.857816:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603614208 00000100:00100000:3.0:1788652280.857826:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603614208 00000100:00100000:3.0:1788652280.857881:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 267 00000100:00100000:3.0:1788652280.857891:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+12:9942:x1875537603614208:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788652280.858123:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+12:9942:x1875537603614208:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 233us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652280.858131:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 267 00000100:00100000:3.0:1788652280.869917:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652280.870029:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603614336 00000100:00100000:2.0:1788652280.870039:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603614336 00000100:00100000:2.0:1788652280.870095:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 268 00000100:00100000:2.0:1788652280.870105:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+12:5588:x1875537603614336:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788652280.870120:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652280.870138:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe40030a00/0x340ed74ef02a77c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0866 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652280.870166:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe40030a00/0x340ed74ef02a77c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0866 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652280.870178:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe40030a00/0x340ed74ef02a77c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0866 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652280.870187:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe40030a00, rc 0) 00000100:00100000:2.0:1788652280.870250:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:5588:x1875537603614336:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 Request processed in 146us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652280.870257:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 268 00000100:00100000:0.0:1788652280.874649:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652280.874763:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603614464 00000100:00100000:1.0:1788652280.874802:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603614464 00000100:00100000:1.0:1788652280.874855:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 269 00000100:00100000:1.0:1788652280.874867:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:5588:x1875537603614464:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788652280.875135:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b113850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:5588:x1875537603614464:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 Request processed in 271us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652280.875143:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 269 00000100:00100000:1.0:1788652280.879095:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652280.879206:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603614592 00000100:00100000:3.0:1788652280.879215:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603614592 00000100:00100000:3.0:1788652280.879343:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 270 00000100:00100000:3.0:1788652280.879353:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:5588:x1875537603614592:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788652280.879751:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:5588:x1875537603614592:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 Request processed in 398us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652280.879760:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 270 00000100:00100000:3.0:1788652280.886901:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652280.887193:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603614720 00000100:00100000:2.0:1788652280.887203:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603614720 00000100:00100000:2.0:1788652280.887266:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 271 00000100:00100000:2.0:1788652280.887276:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:9945:x1875537603614720:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788652280.887693:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:9945:x1875537603614720:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 418us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652280.887702:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 271 00000100:00100000:0.0:1788652280.892358:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652280.892464:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603614848 00000100:00100000:3.0:1788652280.892473:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603614848 00000100:00100000:3.0:1788652280.892533:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 272 00000100:00100000:3.0:1788652280.892542:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:9945:x1875537603614848:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788652280.892860:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:9945:x1875537603614848:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 318us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652280.892869:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 272 00010000:00010000:2.0:1788652281.097533:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652281.481764:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a0c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627766272:0@lo:400:kworker.0 00000100:00100000:1.0:1788652281.481869:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652281.481939:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627766784:0@lo:400:kworker.0 00000100:00100000:1.0:1788652281.481965:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652281.482000:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788652281.482006:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627766400:0@lo:400:kworker.0 00000100:00100000:1.0:1788652281.482027:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652281.482057:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627766784 00000100:00100000:1.0:1788652281.482065:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627766784 00000100:00100000:1.0:1788652281.482114:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788652281.482122:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627766784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652281.482173:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627766784:12345-0@lo:400:kworker.0 Request processed in 52us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652281.482180:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1788652281.482229:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a0c0a80 x1875537627766784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652281.482243:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627766784:0@lo:400:kworker.0 00000100:00100000:3.0:1788652281.483639:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a0c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627766528:0@lo:400:kworker.0 00000100:00100000:3.0:1788652281.483703:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652281.483749:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788652281.483755:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a0c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627766144:0@lo:400:kworker.0 00000100:00100000:3.0:1788652281.483802:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652281.483828:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627766656:0@lo:400:kworker.0 00000100:00100000:3.0:1788652281.483851:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652281.483880:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627766272 00000100:00100000:3.0:1788652281.483886:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627766272 00000100:00100000:3.0:1788652281.483923:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627766400 00000100:00100000:3.0:1788652281.483926:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627766400 00000100:00100000:3.0:1788652281.483942:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627766656 00000100:00100000:3.0:1788652281.483944:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627766656 00000100:00100000:3.0:1788652281.483959:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788652281.483966:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627766272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652281.484010:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627766272:12345-0@lo:400:kworker.0 Request processed in 45us (2142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652281.484017:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788652281.484033:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788652281.484038:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627766400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652281.484063:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627766400:12345-0@lo:400:kworker.0 Request processed in 25us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652281.484068:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788652281.484094:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788652281.484099:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4364b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627766656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652281.484130:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4364b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627766656:12345-0@lo:400:kworker.0 Request processed in 31us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652281.484136:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1788652281.484152:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788652281.484156:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788652281.484187:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627766656:0@lo:400:kworker.0 00000100:00100000:2.0:1788652281.485972:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627766528 00000100:00100000:2.0:1788652281.485986:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627766528 00000100:00100000:2.0:1788652281.486066:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788652281.486074:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4364ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627766528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652281.486147:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4364ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627766528:12345-0@lo:400:kworker.0 Request processed in 74us (2443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652281.486153:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788652281.486187:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1788652281.486191:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cbe4364a300, transno 4294967300 00000100:00100000:2.0:1788652281.486202:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a0c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627766528:0@lo:400:kworker.0 00000100:00100000:2.0:1788652281.486552:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627766144 00000100:00100000:2.0:1788652281.486558:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627766144 00000100:00100000:2.0:1788652281.486584:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788652281.486591:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:3305:x1875537627766144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652281.486629:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:3305:x1875537627766144:12345-0@lo:400:kworker.0 Request processed in 39us (2826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652281.486635:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788652281.486666:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a0c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627766144:0@lo:400:kworker.0 00000100:00100000:1.0:1788652281.487036:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a0c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627766400:0@lo:400:kworker.0 00000100:00100000:1.0:1788652281.487049:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a0c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627766272:0@lo:400:kworker.0 00000100:00080000:3.0:1788652281.487495:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788652281.520974:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652281.521016:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652281.521055:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652281.521092:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652281.521127:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603615104 00000100:00100000:1.0:1788652281.521136:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603615104 00000100:00100000:1.0:1788652281.521187:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603615360 00000100:00100000:1.0:1788652281.521191:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603615360 00000100:00100000:1.0:1788652281.521590:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 100 00000100:00100000:1.0:1788652281.521606:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2347:x1875537603615104:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652281.521766:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2347:x1875537603615104:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 164us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652281.521809:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 100 00000100:00100000:1.0:1788652281.521830:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 101 00000100:00100000:1.0:1788652281.521836:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2347:x1875537603615360:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652281.521858:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2347:x1875537603615360:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 23us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652281.521865:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 101 00000100:00080000:3.0:1788652281.521948:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652281.521964:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603614976 00000100:00100000:3.0:1788652281.521969:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603614976 00000100:00100000:3.0:1788652281.522010:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 274 00000100:00100000:3.0:1788652281.522017:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2347:x1875537603614976:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1788652281.522041:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2347:x1875537603614976:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 26us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652281.522047:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 274 00000100:00100000:0.0:1788652281.522131:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603615232 00000100:00100000:0.0:1788652281.522135:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603615232 00000100:00100000:0.0:1788652281.522177:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 59 00000100:00100000:0.0:1788652281.522183:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2347:x1875537603615232:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1788652281.522218:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2347:x1875537603615232:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 35us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652281.522224:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 59 00000100:00080000:3.0:1788652281.522727:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788652281.672536:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788652281.992207:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788652281.992494:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627766912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788652281.992559:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652281.992747:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627766912 00000100:00100000:0.0:1788652281.992756:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627766912 00000100:00100000:0.0:1788652281.992874:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788652281.992885:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe43649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627766912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788652281.992929:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788652281.992994:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe43649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627766912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652281.993018:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788652281.993088:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe493b8700 x1875537627766912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652281.993110:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627766912:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788652282.125717:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652283.016168:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4364b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627767040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788652283.016248:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652283.016371:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627767040 00000100:00100000:1.0:1788652283.016379:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627767040 00000100:00100000:1.0:1788652283.016444:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788652283.016455:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627767040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788652283.016489:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788652283.016843:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788652283.017083:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627767040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 629us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652283.017093:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788652283.017225:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4364b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627767040:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788652283.143992:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652284.168721:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652285.192550:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652286.216072:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652286.605916:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627767296:0@lo:400:kworker.0 00000100:00100000:0.0:1788652286.606012:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652286.606026:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627767168:0@lo:400:kworker.0 00000100:00100000:3.0:1788652286.606072:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652286.606138:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627767168 00000100:00100000:3.0:1788652286.606146:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627767168 00000100:00100000:2.0:1788652286.606181:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875537627767424:0@lo:400:kworker.0 00000100:00100000:3.0:1788652286.606190:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788652286.606201:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:3306:x1875537627767168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652286.606221:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627767296 00000100:00100000:0.0:1788652286.606227:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627767296 00000100:00100000:2.0:1788652286.606233:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652286.606269:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627767424 00000100:00100000:0.0:1788652286.606273:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627767424 00000100:00100000:3.0:1788652286.606305:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:3306:x1875537627767168:12345-0@lo:400:kworker.0 Request processed in 105us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652286.606306:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788652286.606318:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788652286.606322:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a0c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627767296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652286.606371:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627767168:0@lo:400:kworker.0 00000100:00100000:2.0:1788652286.606384:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a0c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627767296:12345-0@lo:400:kworker.0 Request processed in 55us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652286.606393:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788652286.606412:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788652286.606416:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627767296:0@lo:400:kworker.0 00000100:00100000:2.0:1788652286.606421:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875537627767424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652286.606458:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875537627767424:12345-0@lo:400:kworker.0 Request processed in 39us (228us total) trans 0 rc 0/0 00000100:00080000:3.0:1788652286.606462:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652286.606466:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788652286.606491:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875537627767424:0@lo:400:kworker.0 00000100:00100000:2.0:1788652286.607489:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627767552:0@lo:400:kworker.0 00000100:00100000:2.0:1788652286.607535:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652286.607576:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788652286.607583:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627767680:0@lo:400:kworker.0 00000100:00100000:2.0:1788652286.607609:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652286.608015:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627767552 00000100:00100000:1.0:1788652286.608022:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627767552 00000100:00100000:1.0:1788652286.608087:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788652286.608095:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627767552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652286.608146:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627767552:12345-0@lo:400:kworker.0 Request processed in 52us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652286.608155:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788652286.608203:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627767552:0@lo:400:kworker.0 00000100:00100000:0.0:1788652286.608559:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627767680 00000100:00100000:0.0:1788652286.608565:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627767680 00000100:00100000:0.0:1788652286.608607:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788652286.608615:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627767680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652286.608650:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788652286.608665:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627767808:0@lo:400:kworker.0 00000100:00100000:0.0:1788652286.608671:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627767680:12345-0@lo:400:kworker.0 Request processed in 55us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652286.608679:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788652286.608705:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652286.608732:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627767808 00000100:00100000:0.0:1788652286.608737:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627767808 00000100:00100000:0.0:1788652286.608801:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788652286.608808:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe43648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627767808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652286.608842:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe43648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627767808:12345-0@lo:400:kworker.0 Request processed in 35us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652286.608848:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1788652286.608913:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe493baa00 x1875537627767808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652286.608927:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627767808:0@lo:400:kworker.0 00000100:00080000:2.0:1788652286.609326:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788652286.609332:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788652286.609334:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788652286.609419:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627767680:0@lo:400:kworker.0 00000100:00100000:0.0:1788652286.642119:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652286.642229:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603615488 00000100:00100000:1.0:1788652286.642239:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603615488 00000100:00100000:1.0:1788652286.642301:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 276 00000100:00100000:1.0:1788652286.642310:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2347:x1875537603615488:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652286.642388:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2347:x1875537603615488:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 79us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652286.642396:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 276 00000100:00100000:0.0:1788652286.646654:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652286.646697:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652286.646808:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652286.646913:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603615616 00000100:00100000:2.0:1788652286.646937:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603615616 00000100:00100000:2.0:1788652286.647024:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603615872 00000100:00100000:2.0:1788652286.647027:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603615872 00000100:00100000:2.0:1788652286.647048:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 105 00000100:00100000:2.0:1788652286.647058:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2347:x1875537603615616:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652286.647129:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2347:x1875537603615616:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 72us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652286.647136:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 105 00000100:00100000:2.0:1788652286.647152:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 106 00000100:00100000:2.0:1788652286.647159:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2346:x1875537603615872:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652286.647575:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2346:x1875537603615872:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 414us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652286.647582:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 106 00000100:00100000:1.0:1788652286.647662:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603615744 00000100:00100000:1.0:1788652286.647668:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603615744 00000100:00100000:1.0:1788652286.647705:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 62 00000100:00100000:1.0:1788652286.647712:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2347:x1875537603615744:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652286.647741:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2347:x1875537603615744:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 30us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652286.647761:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 62 00000100:00080000:0.0:1788652286.647859:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788652286.647870:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652287.113613:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627767936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788652287.113728:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652287.116368:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627767936 00000100:00100000:1.0:1788652287.116387:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627767936 00000100:00100000:1.0:1788652287.116479:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788652287.116492:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627767936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788652287.116548:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788652287.116678:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627767936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 189us (2950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652287.116686:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1788652287.117121:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe493b9880 x1875537627767936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652287.117149:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627767936:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788652287.240055:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652288.139109:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4364b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627768064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788652288.139198:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652288.139369:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627768064 00000100:00100000:0.0:1788652288.139378:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627768064 00000100:00100000:0.0:1788652288.139476:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788652288.139498:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627768064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788652288.139553:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788652288.139651:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788652288.140212:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627768064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 725us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652288.140220:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788652288.143828:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4364b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627768064:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788652288.264106:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652289.288002:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652290.311996:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652291.338393:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652291.720034:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875537627768448:0@lo:400:kworker.0 00000100:00100000:2.0:1788652291.720102:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652291.720178:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627768576:0@lo:400:kworker.0 00000100:00100000:2.0:1788652291.720192:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788652291.720202:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627768320:0@lo:400:kworker.0 00000100:00100000:1.0:1788652291.720218:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652291.720236:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652291.720261:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788652291.720265:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a406d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627768832:0@lo:400:kworker.0 00000100:00100000:1.0:1788652291.720272:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627768192:0@lo:400:kworker.0 00000100:00100000:2.0:1788652291.720294:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652291.720342:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627768576 00000100:00100000:2.0:1788652291.720350:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627768576 00000100:00100000:1.0:1788652291.720379:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652291.720407:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627768704:0@lo:400:kworker.0 00000100:00100000:2.0:1788652291.720420:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627768832 00000100:00100000:2.0:1788652291.720425:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627768832 00000100:00100000:1.0:1788652291.720433:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652291.720459:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788652291.720467:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627768576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652291.720483:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788652291.720494:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a21b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627768832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652291.720535:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627768576:12345-0@lo:400:kworker.0 Request processed in 67us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652291.720543:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a21b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627768832:12345-0@lo:400:kworker.0 Request processed in 50us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652291.720548:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788652291.720556:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788652291.720575:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627768448 00000100:00100000:2.0:1788652291.720581:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627768448 00000100:00080000:1.0:1788652291.720589:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788652291.720595:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788652291.720598:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788652291.720626:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627768320 00000100:00100000:2.0:1788652291.720630:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627768320 00000100:00100000:1.0:1788652291.720640:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627768576:0@lo:400:kworker.0 00000100:00100000:2.0:1788652291.720644:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627768704 00000100:00100000:2.0:1788652291.720649:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627768704 00000100:00100000:2.0:1788652291.720674:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788652291.720685:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788652291.720686:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875537627768448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652291.720697:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627768320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652291.720864:0:6701:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788652291.720873:0:6701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1788652291.720889:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788652291.720897:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788652291.720905:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627768704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652291.721168:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627768192 00000100:00100000:0.0:1788652291.721174:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627768192 00000100:00100000:0.0:1788652291.721205:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788652291.721212:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:3305:x1875537627768192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652291.722005:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875537627768448:12345-0@lo:400:kworker.0 Request processed in 1320us (1899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652291.722016:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:2.0:1788652291.722045:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788652291.722079:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a406d80 x1875537627768832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652291.722091:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a406d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627768832:0@lo:400:kworker.0 00000100:00100000:2.0:1788652291.722123:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875537627768448:0@lo:400:kworker.0 00000100:00100000:3.0:1788652291.724956:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627768704:12345-0@lo:400:kworker.0 Request processed in 4042us (4514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652291.724971:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788652291.725108:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627768320:12345-0@lo:400:kworker.0 Request processed in 4412us (4871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652291.725119:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788652291.725160:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75985c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627768704:0@lo:400:kworker.0 00000100:00100000:3.0:1788652291.725165:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627768320:0@lo:400:kworker.0 00000100:00100000:0.0:1788652291.725861:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:3305:x1875537627768192:12345-0@lo:400:kworker.0 Request processed in 4646us (5479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652291.725871:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788652291.726037:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627768192:0@lo:400:kworker.0 00000100:00100000:3.0:1788652291.764366:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652291.764485:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652291.764573:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603616128 00000100:00100000:0.0:1788652291.764584:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603616128 00000100:00100000:3.0:1788652291.764660:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652291.764687:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603616384 00000100:00100000:3.0:1788652291.764691:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603616384 00000100:00100000:0.0:1788652291.764792:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 110 00000100:00100000:0.0:1788652291.764803:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4364a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2349:x1875537603616128:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1788652291.764876:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4364a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2349:x1875537603616128:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 75us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652291.764884:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 110 00000100:00100000:2.0:1788652291.765305:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603616000 00000100:00100000:2.0:1788652291.765312:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603616000 00000100:00100000:2.0:1788652291.765404:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 278 00000100:00100000:2.0:1788652291.765413:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2348:x1875537603616000:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652291.765453:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2348:x1875537603616000:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 41us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652291.765460:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 278 00000100:00080000:1.0:1788652291.766918:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652291.773790:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 111 00000100:00100000:3.0:1788652291.773805:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4364aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2349:x1875537603616384:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652291.773956:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652291.774025:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603616256 00000100:00100000:2.0:1788652291.774033:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603616256 00000100:00100000:3.0:1788652291.774954:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4364aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2349:x1875537603616384:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 80us (9221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652291.774968:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 111 00000100:00100000:2.0:1788652291.779410:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 65 00000100:00100000:2.0:1788652291.779426:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a218a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2348:x1875537603616256:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652291.779515:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a218a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2348:x1875537603616256:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 93us (5560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652291.779523:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 65 00000100:00080000:1.0:1788652291.780339:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788652291.913873:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788652292.232953:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627768960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788652292.233037:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652292.233193:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627768960 00000100:00100000:2.0:1788652292.233202:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627768960 00000100:00100000:2.0:1788652292.233266:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788652292.233276:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4364b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627768960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788652292.233311:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788652292.233372:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4364b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627768960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652292.233392:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788652292.233477:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe493b9880 x1875537627768960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652292.233500:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627768960:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788652292.361964:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652293.256352:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788652293.256375:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4364b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627769088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788652293.256440:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652293.256687:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627769088 00000100:00100000:1.0:1788652293.256695:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627769088 00000100:00080000:2.0:1788652293.256814:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788652293.256895:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788652293.256916:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a0c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627769088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788652293.257113:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788652293.257174:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a0c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627769088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 270us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652293.257183:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788652293.257318:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4364b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627769088:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788652293.385930:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652294.408221:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652295.432086:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652296.456617:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652296.840098:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627769216:0@lo:400:kworker.0 00000100:00100000:0.0:1788652296.840174:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652296.840237:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875537627769728:0@lo:400:kworker.0 00000100:00100000:0.0:1788652296.840264:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652296.840289:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788652296.840294:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627769600:0@lo:400:kworker.0 00000100:00100000:0.0:1788652296.840318:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652296.840351:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627769600 00000100:00100000:0.0:1788652296.840358:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627769600 00000100:00100000:0.0:1788652296.840412:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788652296.840419:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627769600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652296.840468:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627769600:12345-0@lo:400:kworker.0 Request processed in 50us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652296.840476:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788652296.840515:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627769600:0@lo:400:kworker.0 00000100:00100000:2.0:1788652296.840661:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627769216 00000100:00100000:2.0:1788652296.840666:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627769216 00000100:00100000:2.0:1788652296.840699:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788652296.840717:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:3306:x1875537627769216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652296.840755:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:3306:x1875537627769216:12345-0@lo:400:kworker.0 Request processed in 40us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652296.840761:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:2.0:1788652296.840808:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788652296.840829:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627769216:0@lo:400:kworker.0 00000100:00100000:3.0:1788652296.840916:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627769344:0@lo:400:kworker.0 00000100:00100000:3.0:1788652296.840947:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652296.840976:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a406d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627769856:0@lo:400:kworker.0 00000100:00100000:3.0:1788652296.840997:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652296.841013:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788652296.841018:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627769472:0@lo:400:kworker.0 00000100:00100000:3.0:1788652296.841039:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652296.841155:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627769728 00000100:00100000:2.0:1788652296.841160:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627769728 00000100:00100000:2.0:1788652296.841191:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627769344 00000100:00100000:2.0:1788652296.841194:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627769344 00000100:00100000:2.0:1788652296.841214:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627769472 00000100:00100000:2.0:1788652296.841217:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627769472 00000100:00100000:2.0:1788652296.841230:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788652296.841236:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875537627769728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652296.841285:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875537627769728:12345-0@lo:400:kworker.0 Request processed in 48us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652296.841292:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788652296.841307:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788652296.841328:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4364b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627769344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652296.841360:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4364b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627769344:12345-0@lo:400:kworker.0 Request processed in 33us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652296.841366:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788652296.841377:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788652296.841384:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627769472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652296.841408:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627769472:12345-0@lo:400:kworker.0 Request processed in 25us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652296.841413:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:2.0:1788652296.841427:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652296.841452:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875537627769728:0@lo:400:kworker.0 00000100:00100000:2.0:1788652296.841472:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627769856 00000100:00100000:2.0:1788652296.841476:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627769856 00000100:00100000:2.0:1788652296.841503:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788652296.841509:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627769856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652296.841538:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627769856:12345-0@lo:400:kworker.0 Request processed in 30us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652296.841543:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1788652296.841556:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788652296.841752:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627769472:0@lo:400:kworker.0 00000100:00100000:3.0:1788652296.841801:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627769344:0@lo:400:kworker.0 00010000:00080000:3.0:1788652296.841815:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a406d80 x1875537627769856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652296.841824:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a406d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627769856:0@lo:400:kworker.0 00000100:00100000:3.0:1788652296.882383:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652296.882512:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652296.882883:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603616640 00000100:00100000:1.0:1788652296.882895:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603616640 00000100:00100000:1.0:1788652296.882973:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 115 00000100:00100000:1.0:1788652296.882984:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2348:x1875537603616640:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652296.883064:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2348:x1875537603616640:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 82us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652296.883072:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 115 00000100:00080000:2.0:1788652296.883541:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788652296.884331:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603616512 00000100:00100000:0.0:1788652296.884339:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603616512 00000100:00100000:0.0:1788652296.884390:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 280 00000100:00100000:0.0:1788652296.884397:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2348:x1875537603616512:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1788652296.884449:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2348:x1875537603616512:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 53us (2353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652296.884456:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 280 00000100:00100000:3.0:1788652296.893876:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652296.894009:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652296.900263:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603616896 00000100:00100000:1.0:1788652296.900294:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603616896 00000100:00100000:1.0:1788652296.900394:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 116 00000100:00100000:1.0:1788652296.900405:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2348:x1875537603616896:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652296.900494:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2348:x1875537603616896:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 90us (6484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652296.900502:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 116 00000100:00080000:2.0:1788652296.901077:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788652296.901389:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603616768 00000100:00100000:0.0:1788652296.901397:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603616768 00000100:00100000:0.0:1788652296.901514:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:0.0:1788652296.901524:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2345:x1875537603616768:12345-192.168.203.50@tcp:9:kworker.0 00000020:00000080:0.0:1788652296.901548:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a7703 00000100:00080000:0.0:1788652296.901558:0:6680:0:(import.c:65:import_set_state_nolock()) ffff8cbe513af000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788652296.901608:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:2.0:1788652296.902313:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788652296.902372:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652296.902650:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+2:2345:x1875537603616768:12345-192.168.203.50@tcp:9:kworker.0 Request processed in 1123us (8779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652296.903029:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:0.0:1788652297.353259:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788652297.353284:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627769984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788652297.353352:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652297.354575:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627769984 00000100:00100000:2.0:1788652297.354587:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627769984 00000100:00100000:2.0:1788652297.354650:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788652297.354660:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627769984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788652297.354699:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788652297.354802:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627769984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652297.354811:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1788652297.354852:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe493baa00 x1875537627769984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652297.354873:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627769984:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788652297.480217:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652298.375992:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788652298.376016:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe51381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627770112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788652298.376087:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652298.376277:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627770112 00000100:00100000:3.0:1788652298.376286:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627770112 00000100:00100000:3.0:1788652298.376353:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788652298.376362:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627770112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788652298.376395:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652298.376440:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627770112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652298.376447:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788652298.376511:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788652298.376557:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe51381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627770112:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788652298.503945:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788652299.484630:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c 00000020:00000080:0.0:1788652299.484639:0:6704:0:(genops.c:885:class_export_put()) final put ffff8cbe513ac800/20ec7f44-aadf-40d6-8a9c-d109a8b21d8c 00000020:00000080:1.0:1788652299.484700:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe513ac800/20ec7f44-aadf-40d6-8a9c-d109a8b21d8c for lustre-OST0000 00000020:00000080:1.0:1788652299.484752:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe513af000 for lustre-OST0000 00010000:00010000:2.0:1788652299.528064:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652300.553033:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788652301.132525:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788652301.577883:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652301.962452:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe51382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627770240:0@lo:400:kworker.0 00000100:00100000:2.0:1788652301.962547:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652301.962744:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627770240 00000100:00100000:0.0:1788652301.962753:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627770240 00000100:00100000:0.0:1788652301.962834:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788652301.962844:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:3306:x1875537627770240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652301.963013:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe51383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627770624:0@lo:400:kworker.0 00000100:00100000:1.0:1788652301.963049:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652301.963116:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe51383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627770368:0@lo:400:kworker.0 00000100:00100000:1.0:1788652301.963146:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652301.963169:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788652301.963176:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe51382d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627770496:0@lo:400:kworker.0 00000100:00100000:1.0:1788652301.963200:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652301.963225:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627770368 00000100:00100000:1.0:1788652301.963229:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627770368 00000100:00100000:1.0:1788652301.963258:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627770496 00000100:00100000:1.0:1788652301.963261:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627770496 00000100:00100000:1.0:1788652301.963290:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788652301.963298:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627770368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652301.963336:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627770368:12345-0@lo:400:kworker.0 Request processed in 39us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652301.963343:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788652301.963359:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788652301.963366:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627770496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652301.963411:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627770496:12345-0@lo:400:kworker.0 Request processed in 46us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652301.963417:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1788652301.963439:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788652301.963472:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe51382d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627770496:0@lo:400:kworker.0 00000100:00100000:1.0:1788652301.963484:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe51383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627770368:0@lo:400:kworker.0 00000100:00100000:1.0:1788652301.963520:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627770624 00000100:00100000:1.0:1788652301.963523:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627770624 00000100:00100000:1.0:1788652301.963566:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788652301.963573:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627770624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652301.963608:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627770624:12345-0@lo:400:kworker.0 Request processed in 35us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652301.963626:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788652301.963641:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788652301.963657:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe51383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627770624:0@lo:400:kworker.0 00000100:00100000:0.0:1788652301.969897:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:3306:x1875537627770240:12345-0@lo:400:kworker.0 Request processed in 7043us (7350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652301.969924:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788652301.970308:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe51382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627770240:0@lo:400:kworker.0 00000100:00100000:2.0:1788652301.970687:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe51381500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875537627770752:0@lo:400:kworker.0 00000100:00100000:2.0:1788652301.970745:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652301.970846:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627770752 00000100:00100000:1.0:1788652301.970854:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627770752 00000100:00100000:1.0:1788652301.970927:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788652301.970937:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875537627770752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652301.971276:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788652301.971289:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe51383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627770880:0@lo:400:kworker.0 00000100:00100000:0.0:1788652301.971323:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788652301.971359:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652301.973556:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627770880 00000100:00100000:3.0:1788652301.973570:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627770880 00000100:00100000:3.0:1788652301.973678:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788652301.973688:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627770880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652301.973799:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627770880:12345-0@lo:400:kworker.0 Request processed in 84us (2446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652301.973808:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1788652301.973960:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788652301.974000:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe51383b80 x1875537627770880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652301.974028:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe51383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627770880:0@lo:400:kworker.0 00000100:00100000:1.0:1788652301.979632:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875537627770752:12345-0@lo:400:kworker.0 Request processed in 8684us (8874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652301.979649:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788652301.979884:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe51381500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875537627770752:0@lo:400:kworker.0 00000100:00100000:3.0:1788652301.999998:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652302.000119:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652302.000156:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652302.001474:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603617280 00000100:00100000:1.0:1788652302.001486:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603617280 00000100:00100000:1.0:1788652302.001566:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603617152 00000100:00100000:1.0:1788652302.001570:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603617152 00000100:00100000:1.0:1788652302.001610:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 120 00000100:00100000:1.0:1788652302.001618:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51382a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2349:x1875537603617280:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652302.001694:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51382a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2349:x1875537603617280:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 76us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652302.001700:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 120 00000100:00100000:1.0:1788652302.001714:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 121 00000100:00100000:1.0:1788652302.001719:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2349:x1875537603617152:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652302.001737:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2349:x1875537603617152:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 19us (1582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652302.001742:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 121 00000100:00080000:3.0:1788652302.004324:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788652302.004501:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603617024 00000100:00100000:0.0:1788652302.004511:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603617024 00000100:00100000:0.0:1788652302.004581:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 282 00000100:00100000:0.0:1788652302.004592:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2349:x1875537603617024:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1788652302.004676:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2349:x1875537603617024:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 85us (4688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652302.004684:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 282 00000100:00100000:2.0:1788652302.474004:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788652302.478980:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627771008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788652302.479080:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652302.479306:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627771008 00000100:00100000:0.0:1788652302.479317:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627771008 00000100:00100000:0.0:1788652302.479380:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788652302.479392:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627771008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788652302.479443:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788652302.479510:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627771008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652302.479517:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788652302.479578:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe75987b80 x1875537627771008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652302.479602:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627771008:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788652302.600574:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788652303.106561:0:11832:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 19:51:40 (1788652300) 00000100:00100000:0.0:1788652303.496642:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe51381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627771136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788652303.496716:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652303.497034:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627771136 00000100:00100000:3.0:1788652303.497043:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627771136 00000100:00100000:3.0:1788652303.497121:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788652303.497132:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627771136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788652303.497170:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652303.497235:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627771136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652303.497242:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788652303.497459:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe51381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627771136:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788652303.497581:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788652303.624095:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652304.648204:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652304.814946:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652304.815258:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603617408 00000100:00100000:1.0:1788652304.815279:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603617408 00000100:00100000:1.0:1788652304.815376:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 32 00000100:00100000:1.0:1788652304.815389:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51381c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:10212:x1875537603617408:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788652304.815418:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1788652304.815444:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788652304.817623:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925000/0x340ed74ef02a77ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f086d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.817719:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924200/0x340ed74ef02a77d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.817733:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924200/0x340ed74ef02a77d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.817746:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924200/0x340ed74ef02a77d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652304.817815:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788652304.817819:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788652304.817861:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924200/0x340ed74ef02a77d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.817890:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925000/0x340ed74ef02a77ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f086d expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.817911:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924200/0x340ed74ef02a77d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f086d expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.817919:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe48da0900) 00010000:00010000:1.0:1788652304.817922:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788652304.817926:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe52924200, rc 0) 00000100:00100000:1.0:1788652304.818002:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51381c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:10212:x1875537603617408:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 2616us (3067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652304.818011:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 32 00000100:00100000:3.0:1788652304.832675:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652304.833059:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603617536 00000100:00100000:1.0:1788652304.833070:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603617536 00000100:00100000:1.0:1788652304.833133:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 33 00000100:00100000:1.0:1788652304.833144:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51380a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:10213:x1875537603617536:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788652304.833166:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652304.833188:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925000/0x340ed74ef02a77dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0874 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833256:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a77e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833284:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a77e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833298:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a77e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833314:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924e00/0x340ed74ef02a77ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833321:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924e00/0x340ed74ef02a77ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833328:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924e00/0x340ed74ef02a77ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833560:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924400/0x340ed74ef02a77f1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833569:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924400/0x340ed74ef02a77f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833576:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924400/0x340ed74ef02a77f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652304.833604:0:6701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788652304.833608:0:6701:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788652304.833630:0:6701:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924400/0x340ed74ef02a77f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833640:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a77e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833655:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a77e3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833662:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a77e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833667:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe52925c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652304.833672:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a77e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833679:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a77e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833692:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe48da0900) 00010000:00010000:1.0:1788652304.833694:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652304.833699:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a77e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833706:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a77e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833719:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924e00/0x340ed74ef02a77ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833736:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924e00/0x340ed74ef02a77ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833742:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924e00/0x340ed74ef02a77ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833747:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe52924e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652304.833756:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924e00/0x340ed74ef02a77ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833762:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924e00/0x340ed74ef02a77ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833821:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8cbe48da0100) 00010000:00010000:1.0:1788652304.833824:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652304.833836:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924e00/0x340ed74ef02a77ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833842:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924e00/0x340ed74ef02a77ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833874:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925000/0x340ed74ef02a77dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0874 expref: 8 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833889:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924400/0x340ed74ef02a77f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0874 expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652304.833897:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cbe48da0300) 00010000:00010000:1.0:1788652304.833899:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788652304.833901:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe52924400, rc 0) 00000100:00100000:1.0:1788652304.833974:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51380a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:10213:x1875537603617536:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 831us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652304.833983:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 33 00000100:00100000:2.0:1788652304.839645:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652304.839746:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603617792 00000100:00100000:3.0:1788652304.840395:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603617792 00000100:00100000:3.0:1788652304.840543:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 34 00000100:00100000:3.0:1788652304.840555:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:10213:x1875537603617792:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788652304.840576:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652304.840613:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a77f8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f087b expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652304.840686:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a77ff lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652304.840702:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a77ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652304.840714:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a77ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652304.840950:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7806 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652304.840960:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7806 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652304.840968:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7806 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652304.841302:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a780d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652304.841312:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a780d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652304.841320:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a780d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652304.841330:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788652304.841614:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a77ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652304.841632:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a77ff lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652304.841639:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a77ff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652304.841645:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652304.841650:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a77ff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652304.841658:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a77ff lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652304.841671:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cbe48da0300) 00010000:00010000:3.0:1788652304.841674:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652304.841679:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a77ff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652304.841685:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a77ff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652304.841698:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7806 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652304.841705:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7806 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652304.841711:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7806 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652304.841716:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652304.841726:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7806 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652304.841869:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7806 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652304.841879:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cbe7fde3e00) 00010000:00010000:3.0:1788652304.841882:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652304.841885:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7806 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652304.841891:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7806 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652304.842369:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a77f8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f087b expref: 10 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652304.842386:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a780d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f087b expref: 9 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652304.842393:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbe7fde3200) 00010000:00010000:3.0:1788652304.842396:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652304.842399:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5a00, rc 0) 00000100:00100000:3.0:1788652304.843733:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:10213:x1875537603617792:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 3162us (4080us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788652304.843745:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 34 00000100:00100000:3.0:1788652304.857689:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652304.858616:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603617920 00000100:00100000:1.0:1788652304.858632:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603617920 00000100:00100000:1.0:1788652304.858813:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 35 00000100:00100000:1.0:1788652304.858825:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51382300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:10213:x1875537603617920:12345-192.168.203.50@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788652304.858981:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51382300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:10213:x1875537603617920:12345-192.168.203.50@tcp:59:lhsmtool_posix.0 Request processed in 158us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652304.858989:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 35 00000040:00080000:3.0:1788652305.230866:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788652305.672661:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652306.687723:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652306.687914:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603618048 00000100:00100000:2.0:1788652306.687925:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603618048 00000100:00100000:2.0:1788652306.687996:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 36 00000100:00100000:2.0:1788652306.688013:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a0c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:10255:x1875537603618048:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1788652306.688034:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652306.688053:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a781b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0882 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.688116:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7822 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.688130:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7822 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.688143:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7822 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.688157:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7829 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.688165:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.688172:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788652306.688172:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788652306.688366:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7822 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.688374:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7822 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.688379:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7822 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.688394:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe40031a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652306.688399:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7822 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.688407:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7822 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.688419:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe48da0900) 00010000:00010000:2.0:1788652306.688422:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652306.688427:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7822 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.688434:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7822 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.688447:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.688453:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7829 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.688459:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7829 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.688464:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe40030e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652306.688467:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7829 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.688473:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7829 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.688491:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cbe485ac700) 00010000:00010000:2.0:1788652306.688493:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652306.688497:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7829 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.688514:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7829 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.688549:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a781b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0882 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.688559:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe48da0900) 00010000:00010000:2.0:1788652306.688561:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652306.688565:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a781b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0882 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.688574:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe40031c00, rc 0) 00000100:00100000:2.0:1788652306.688644:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a0c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:10255:x1875537603618048:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 632us (929us total) trans 0 rc 301/301 00000100:00100000:2.0:1788652306.688651:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 36 00000100:00100000:3.0:1788652306.693115:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652306.693248:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603618304 00000100:00100000:2.0:1788652306.693259:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603618304 00000100:00100000:2.0:1788652306.693315:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 37 00000100:00100000:2.0:1788652306.693326:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:10255:x1875537603618304:12345-192.168.203.50@tcp:36:lfs.0 00010000:00010000:2.0:1788652306.693378:0:11683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652306.693405:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924200/0x340ed74ef02a77d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f086d expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.693436:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe48da0900) 00010000:00010000:2.0:1788652306.693446:0:11683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788652306.693659:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a7830 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.693673:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a7830 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.693683:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a7830 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.693696:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7837 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.693703:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7837 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.693709:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7837 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652306.695044:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788652306.695060:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a7830 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.695067:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a7830 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.695074:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a7830 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.695079:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe40031e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652306.695090:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a7830 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.695098:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a7830 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.695111:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe485acc00) 00010000:00010000:2.0:1788652306.695113:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652306.695118:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a7830 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.695123:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a7830 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788652306.695138:0:11683:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000753adba7 reply state 0000000059b58777 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7837 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652306.695146:0:11683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788652306.695249:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+10:10255:x1875537603618304:12345-192.168.203.50@tcp:36:lfs.0 Request processed in 1922us (2142us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788652306.695258:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 37 00010000:00010000:3.0:1788652306.703749:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652306.703862:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7837 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652306.703875:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7837 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652306.703883:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7837 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652306.703889:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652306.703894:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7837 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652306.703902:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7837 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652306.703918:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cbe485ac300) 00010000:00010000:3.0:1788652306.703921:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652306.703926:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7837 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652306.703932:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7837 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652306.788691:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652306.788826:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603618432 00000100:00100000:1.0:1788652306.788836:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603618432 00000100:00100000:1.0:1788652306.788899:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 38 00000100:00100000:1.0:1788652306.788909:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:10263:x1875537603618432:12345-192.168.203.50@tcp:101:lctl.0 00010000:00010000:1.0:1788652306.788934:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652306.788958:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924200/0x340ed74ef02a783e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0889 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652306.789021:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925000/0x340ed74ef02a7845 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652306.789036:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925000/0x340ed74ef02a7845 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652306.789048:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925000/0x340ed74ef02a7845 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652306.789532:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788652306.789537:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788652306.789576:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925000/0x340ed74ef02a7845 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.789603:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924200/0x340ed74ef02a783e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0889 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.789621:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925000/0x340ed74ef02a7845 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0889 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.789646:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe48da0100) 00010000:00010000:2.0:1788652306.789649:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788652306.789653:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe52925000, rc 0) 00000100:00100000:2.0:1788652306.789716:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+10:10263:x1875537603618432:12345-192.168.203.50@tcp:101:lctl.0 Request processed in 807us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652306.789724:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 38 00000100:00100000:3.0:1788652306.891951:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652306.892010:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603618560 00000100:00100000:2.0:1788652306.892020:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603618560 00000100:00100000:2.0:1788652306.892168:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 39 00000100:00100000:2.0:1788652306.892180:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51381180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+10:10269:x1875537603618560:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:2.0:1788652306.892327:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652306.892349:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a784c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0890 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.892409:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7853 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.892423:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7853 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.892433:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7853 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.892446:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a785a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.892453:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a785a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.892477:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a785a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.892658:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f800/0x340ed74ef02a7861 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.892666:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f800/0x340ed74ef02a7861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.892673:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f800/0x340ed74ef02a7861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652306.892697:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788652306.892701:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788652306.892933:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f800/0x340ed74ef02a7861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.892946:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7853 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.892951:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7853 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.892957:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7853 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.892962:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215f400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652306.892965:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7853 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.892972:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7853 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.892989:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe48da0100) 00010000:00010000:2.0:1788652306.892992:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652306.892996:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7853 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.893002:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7853 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.893014:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a785a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.893019:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a785a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.893024:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a785a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.893029:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215fa00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652306.893032:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a785a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.893037:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a785a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.893045:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cbe485acc00) 00010000:00010000:2.0:1788652306.893047:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652306.893050:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a785a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.893169:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a785a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.893346:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a784c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0890 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.893361:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f800/0x340ed74ef02a7861 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0890 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.893369:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:2.0:1788652306.893371:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788652306.893373:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215f800, rc 0) 00000100:00100000:2.0:1788652306.893441:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51381180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+11:10269:x1875537603618560:12345-192.168.203.50@tcp:101:bash.0 Request processed in 1263us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652306.893449:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 39 00000100:00100000:0.0:1788652306.900425:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652306.900483:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603618816 00000100:00100000:2.0:1788652306.900493:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603618816 00000100:00100000:2.0:1788652306.900573:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 40 00000100:00100000:2.0:1788652306.900583:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a0c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+11:10269:x1875537603618816:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:2.0:1788652306.900606:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652306.900627:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7868 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0897 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.900754:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a786f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.900768:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a786f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.900817:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a786f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.900866:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7876 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.900875:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7876 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.900881:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7876 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788652306.901683:0:11683:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788652306.901879:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a787d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.901892:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a787d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.901901:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a787d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.901935:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a786f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.901943:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a786f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.901950:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a786f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.901956:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215fa00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652306.901960:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a786f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.901980:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a786f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.901992:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:2.0:1788652306.901995:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652306.902001:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a786f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.902008:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a786f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788652306.902021:0:11683:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a870839 reply state 00000000f2f2f4cd transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7876 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652306.902029:0:11683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788652306.902061:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7868 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0897 expref: 14 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.902077:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a787d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0897 expref: 13 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.902085:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe485acb00) 00010000:00010000:2.0:1788652306.902088:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788652306.902090:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215fc00, rc 0) 00000100:00100000:2.0:1788652306.902167:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a0c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+14:10269:x1875537603618816:12345-192.168.203.50@tcp:101:bash.0 Request processed in 1585us (1750us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788652306.902176:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 40 00010000:00010000:0.0:1788652306.905816:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7876 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652306.905833:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7876 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652306.905840:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7876 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652306.905846:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215f400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652306.905850:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7876 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652306.905858:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7876 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652306.905874:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cbe485acc00) 00010000:00010000:0.0:1788652306.905877:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652306.905882:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7876 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652306.905887:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7876 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652306.909168:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652306.909604:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603618944 00000100:00100000:1.0:1788652306.909615:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603618944 00000100:00100000:1.0:1788652306.909670:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00100000:1.0:1788652306.909679:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1875537603618944:12345-192.168.203.50@tcp:8:bash.0 00010000:00080000:1.0:1788652306.909713:0:6678:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:1.0:1788652306.909747:0:6678:0:(genops.c:1385:class_connect()) connect: client 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c, cookie 0x340ed74ef02a788b 00002000:00100000:1.0:1788652306.909759:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c/ffff8cbe7a485800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788652306.909831:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788652306.910067:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788652306.910110:0:6678:0:(import.c:65:import_set_state_nolock()) ffff8cbe7a481800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788652306.910185:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2345:x1875537603618944:12345-192.168.203.50@tcp:8:bash.0 Request processed in 505us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652306.910193:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00100000:3.0:1788652306.915369:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652306.915603:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603619072 00000100:00100000:1.0:1788652306.915612:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603619072 00000100:00100000:1.0:1788652306.915697:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:1.0:1788652306.915710:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:0:x1875537603619072:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:1.0:1788652306.915731:0:8297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652306.915760:0:8297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4e23eb5/0x340ed74ef02a7892 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f089e expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788652306.915839:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1788652306.915916:0:8297:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788652306.915937:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=323s v=(0 0) 00010000:00010000:1.0:1788652306.915945:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652306.915957:0:8297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4e23eb5/0x340ed74ef02a7892 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f089e expref: 7 pid: 8297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652306.915984:0:8297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a4e23eb5/0x340ed74ef02a7892 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f089e expref: 7 pid: 8297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652306.916001:0:8297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe52924e00, rc 0) 00000100:00100000:1.0:1788652306.916410:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:0:x1875537603619072:12345-192.168.203.50@tcp:101:bash.0 Request processed in 702us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652306.916930:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:3.0:1788652306.928428:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652306.928539:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603619200 00000100:00100000:1.0:1788652306.928549:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603619200 00000100:00100000:1.0:1788652306.928613:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 22 00000100:00100000:1.0:1788652306.928625:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51383b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:10269:x1875537603619200:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:1.0:1788652306.928644:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652306.928663:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007601e071/0x340ed74ef02a7899 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f08a5 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652306.928694:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4e23eb5/0x340ed74ef02a7892 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f089e expref: 8 pid: 8297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652306.928703:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652306.928708:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652306.928715:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007601e071/0x340ed74ef02a7899 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08a5 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652306.928750:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a4e23eb5/0x340ed74ef02a7892 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f089e expref: 8 pid: 8297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652306.928765:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a4e23eb5/0x340ed74ef02a7892 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f089e expref: 8 pid: 8297 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652306.928823:0:6678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75986300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6678:1875537627771264:192.168.203.50@tcp:104: 00000100:00100000:1.0:1788652306.928924:0:6678:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4502c900 going to sleep for 11 seconds 00000100:00100000:0.0:1788652306.933605:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652306.933825:0:6678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75986300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6678:1875537627771264:192.168.203.50@tcp:104: 00010000:00010000:1.0:1788652306.933859:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007601e071/0x340ed74ef02a7899 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08a5 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652306.933883:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe52925c00, rc 0) 00000100:00100000:1.0:1788652306.933944:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51383b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:10269:x1875537603619200:12345-192.168.203.50@tcp:101:bash.0 Request processed in 5322us (5526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652306.933953:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 22 00000100:00100000:2.0:1788652306.935540:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603619328 00000100:00100000:2.0:1788652306.935568:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603619328 00010000:00010000:2.0:1788652306.935615:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a4e23eb5/0x340ed74ef02a7892 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f089e expref: 8 pid: 8297 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652306.935709:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 35 00000100:00100000:2.0:1788652306.935720:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2347:x1875537603619328:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652306.935735:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652306.935758:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a4e23eb5/0x340ed74ef02a7892 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f089e expref: 8 pid: 8297 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.935796:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a4e23eb5/0x340ed74ef02a7892 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f089e expref: 8 pid: 8297 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.935826:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4e23eb5/0x340ed74ef02a7892 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f089e expref: 8 pid: 8297 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.935843:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652306.935848:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652306.935857:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007601e071/0x340ed74ef02a7899 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08a5 expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.935868:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007601e071/0x340ed74ef02a7899 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08a5 expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652306.935908:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007601e071/0x340ed74ef02a7899 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08a5 expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652306.935936:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5820:1875537627771392:192.168.203.50@tcp:105: 00000100:00100000:2.0:1788652306.936016:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b76a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652306.939790:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5820:1875537627771392:192.168.203.50@tcp:105: 00010000:00010000:2.0:1788652306.939821:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652306.939877:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2347:x1875537603619328:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 4159us (6282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652306.939888:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 35 00000100:00100000:3.0:1788652306.942578:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652306.942675:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603619584 00000100:00100000:1.0:1788652306.942685:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603619584 00000100:00100000:1.0:1788652306.942743:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:1.0:1788652306.942753:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+13:10269:x1875537603619584:12345-192.168.203.50@tcp:35:bash.0 00000100:00100000:1.0:1788652306.943138:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+14:10269:x1875537603619584:12345-192.168.203.50@tcp:35:bash.0 Request processed in 386us (568us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788652306.943146:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:3.0:1788652307.023127:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652307.023233:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603619840 00000100:00100000:2.0:1788652307.023242:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603619840 00000100:00100000:2.0:1788652307.023313:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 41 00000100:00100000:2.0:1788652307.023324:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+14:10279:x1875537603619840:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1788652307.023349:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652307.023372:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a78a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f08ac expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652307.023462:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788652307.023589:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a78a0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08ac expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.023604:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe48da0100) 00010000:00010000:2.0:1788652307.023607:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788652307.023612:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a78a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08ac expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.023626:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215e400, rc 0) 00000100:00100000:2.0:1788652307.023820:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+15:10279:x1875537603619840:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 447us (725us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788652307.023828:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 41 00000100:00100000:0.0:1788652307.031228:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652307.032367:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603620096 00000100:00100000:1.0:1788652307.032379:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603620096 00000100:00100000:1.0:1788652307.032492:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:1.0:1788652307.032513:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a21aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+15:10279:x1875537603620096:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:1.0:1788652307.032954:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a21aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+16:10279:x1875537603620096:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 451us (1734us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788652307.032963:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:0.0:1788652307.083884:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627771904:0@lo:400:kworker.0 00000100:00100000:0.0:1788652307.083968:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652307.084043:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788652307.084049:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627771520:0@lo:400:kworker.0 00000100:00100000:0.0:1788652307.084090:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652307.084115:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627772032:0@lo:400:kworker.0 00000100:00100000:0.0:1788652307.084140:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652307.084168:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627771648:0@lo:400:kworker.0 00000100:00100000:0.0:1788652307.084207:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652307.084229:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627772160:0@lo:400:kworker.0 00000100:00100000:0.0:1788652307.084252:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652307.084270:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788652307.084276:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd422ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627771776:0@lo:400:kworker.0 00000100:00100000:0.0:1788652307.084296:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652307.084326:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627771520 00000100:00100000:0.0:1788652307.084332:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627771520 00000100:00100000:0.0:1788652307.084376:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788652307.084385:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+19:3305:x1875537627771520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652307.084433:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+19:3305:x1875537627771520:12345-0@lo:400:kworker.0 Request processed in 49us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652307.084440:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788652307.084473:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627772032 00000100:00100000:0.0:1788652307.084477:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627772032 00000100:00100000:0.0:1788652307.084520:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627771648 00000100:00100000:0.0:1788652307.084523:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627771648 00000100:00100000:0.0:1788652307.084539:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627771776 00000100:00100000:0.0:1788652307.084543:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627771776 00000100:00100000:0.0:1788652307.084558:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788652307.084572:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627772032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652307.084604:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627772032:12345-0@lo:400:kworker.0 Request processed in 33us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652307.084610:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788652307.084622:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788652307.084628:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe49418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627771648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652307.084657:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe49418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627771648:12345-0@lo:400:kworker.0 Request processed in 29us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652307.084663:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788652307.084674:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788652307.084680:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe49419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627771776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652307.084707:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe49419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627771776:12345-0@lo:400:kworker.0 Request processed in 28us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652307.084711:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788652307.084731:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627771904 00000100:00100000:0.0:1788652307.084734:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627771904 00000100:00100000:0.0:1788652307.084758:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627772160 00000100:00100000:0.0:1788652307.084760:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627772160 00000100:00100000:0.0:1788652307.084815:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788652307.084821:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a218000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627771904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652307.084849:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a218000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627771904:12345-0@lo:400:kworker.0 Request processed in 28us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652307.084853:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788652307.084863:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788652307.084869:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe49418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627772160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652307.084894:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe49418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627772160:12345-0@lo:400:kworker.0 Request processed in 26us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652307.084906:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1788652307.084928:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788652307.084932:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788652307.084934:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788652307.084965:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627771776:0@lo:400:kworker.0 00000100:00100000:0.0:1788652307.084975:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627771648:0@lo:400:kworker.0 00000100:00100000:0.0:1788652307.084983:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627772160:0@lo:400:kworker.0 00000100:00100000:0.0:1788652307.085017:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627771520:0@lo:400:kworker.0 00000100:00100000:0.0:1788652307.085028:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627772032:0@lo:400:kworker.0 00000100:00100000:0.0:1788652307.085037:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd422c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627771904:0@lo:400:kworker.0 00000100:00100000:0.0:1788652307.109736:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652307.110176:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603620224 00000100:00100000:2.0:1788652307.110186:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603620224 00000100:00100000:2.0:1788652307.110255:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 42 00000100:00100000:2.0:1788652307.110266:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4941a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+16:10285:x1875537603620224:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1788652307.110290:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652307.110311:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a78ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f08b3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.110410:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a78b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.110424:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a78b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.110438:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a78b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652307.110483:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788652307.110487:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788652307.110514:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a78b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.110540:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a78ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08b3 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.110558:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a78b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08b3 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.110578:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:2.0:1788652307.110581:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788652307.110585:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215fa00, rc 0) 00000100:00100000:2.0:1788652307.110648:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4941a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+17:10285:x1875537603620224:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 382us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652307.110655:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 42 00000100:00100000:3.0:1788652307.114171:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652307.114456:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603620480 00000100:00100000:0.0:1788652307.114466:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603620480 00000100:00100000:0.0:1788652307.114538:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 43 00000100:00100000:0.0:1788652307.114549:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+17:10285:x1875537603620480:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1788652307.114659:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652307.114681:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a78bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f08ba expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.114909:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a78c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.114924:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a78c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.114948:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a78c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652307.114960:0:6701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788652307.115088:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a78bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08ba expref: 20 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.115107:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a78c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08ba expref: 19 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.115115:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe485acb00) 00010000:00010000:0.0:1788652307.115118:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788652307.115121:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e56800, rc 0) 00000100:00100000:0.0:1788652307.115228:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+19:10285:x1875537603620480:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 681us (1063us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788652307.115235:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 43 00000100:00100000:0.0:1788652307.118605:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652307.118691:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603620736 00000100:00100000:2.0:1788652307.118702:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603620736 00000100:00100000:2.0:1788652307.118842:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:2.0:1788652307.118852:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4941b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+19:2349:x1875537603620736:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652307.118867:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652307.118890:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a78c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08ba expref: 19 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.118908:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe485acb00) 00010000:00010000:2.0:1788652307.118918:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652307.118979:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4941b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+18:2349:x1875537603620736:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 127us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652307.118987:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:3.0:1788652307.120238:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652307.120724:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603620864 00000100:00100000:2.0:1788652307.120732:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603620864 00000100:00100000:0.0:1788652307.120931:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 44 00000100:00100000:0.0:1788652307.120943:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+18:10285:x1875537603620864:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1788652307.120965:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652307.120984:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a78d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f08c1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.121145:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a78d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.121160:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a78d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.121184:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a78d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652307.121199:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788652307.121458:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a78d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08c1 expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.121476:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a78d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08c1 expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.121485:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe485acb00) 00010000:00010000:0.0:1788652307.121488:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788652307.121492:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e56e00, rc 0) 00000100:00100000:0.0:1788652307.121566:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+20:10285:x1875537603620864:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 625us (1334us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788652307.121573:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 44 00000100:00100000:3.0:1788652307.124656:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652307.124710:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652307.124822:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603621120 00000100:00100000:2.0:1788652307.124832:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603621120 00000100:00100000:2.0:1788652307.124895:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 125 00000100:00100000:1.0:1788652307.124907:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603620992 00000100:00100000:2.0:1788652307.124908:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51381f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2348:x1875537603621120:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652307.124913:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603620992 00000100:00100000:1.0:1788652307.124950:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 284 00000100:00100000:1.0:1788652307.124959:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2348:x1875537603620992:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652307.125008:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51381f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2348:x1875537603621120:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 98us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652307.125008:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2348:x1875537603620992:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 45us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652307.125026:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 284 00000100:00100000:2.0:1788652307.125031:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 125 00000100:00080000:0.0:1788652307.126750:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788652307.134621:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652307.134712:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603621248 00000100:00100000:0.0:1788652307.134722:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603621248 00000100:00100000:0.0:1788652307.134829:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:0.0:1788652307.134841:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2346:x1875537603621248:12345-192.168.203.50@tcp:1:lfs.0 00010000:00010000:0.0:1788652307.134890:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ff5d6f6/0x340ed74ef02a78e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.134911:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007601e071/0x340ed74ef02a7899 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08a5 expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.134938:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788652307.134943:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788652307.134948:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ff5d6f6/0x340ed74ef02a78e6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.134982:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007601e071/0x340ed74ef02a7899 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08a5 expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.134997:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007601e071/0x340ed74ef02a7899 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08a5 expref: 7 pid: 6678 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652307.135011:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4941ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6680:1875537627772288:192.168.203.50@tcp:104: 00000100:00100000:0.0:1788652307.135133:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b286300 going to sleep for 11 seconds 00000100:00100000:2.0:1788652307.137698:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652307.137855:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603621376 00000100:00100000:3.0:1788652307.137865:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603621376 00002000:00100000:3.0:1788652307.137915:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8cbe4b190700 x1875537603621376/t0(0) o4->20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp:693/0 lens 504/0 e 0 to 0 dl 1788652318 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788652307.137925:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe4b190700 with x1875537603621376 ext(0->12) 00010000:00010000:3.0:1788652307.137934:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007601e071/0x340ed74ef02a7899 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08a5 expref: 8 pid: 6678 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.137951:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007601e071/0x340ed74ef02a7899 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08a5 expref: 8 pid: 6678 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788652307.137958:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cbe4b190700 00000100:00100000:3.0:1788652307.137991:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:3.0:1788652307.138000:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2346:x1875537603621376:12345-192.168.203.50@tcp:4:lfs.0 00000100:00100000:0.0:1788652307.138657:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4941ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6680:1875537627772288:192.168.203.50@tcp:104: 00010000:00010000:0.0:1788652307.138683:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009ff5d6f6/0x340ed74ef02a78e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1788652307.192861:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c 00000100:00100000:2.0:1788652307.193541:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:2346:x1875537603621376:12345-192.168.203.50@tcp:4:lfs.0 Request processed in 55536us (55846us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788652307.193558:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 0 00002000:00100000:2.0:1788652307.193571:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8cbe4b190700 x1875537603621376/t4294967299(0) o4->20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp:693/0 lens 504/448 e 0 to 0 dl 1788652318 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788652307.193582:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe4b190700 with x1875537603621376 ext(0->12) 00010000:00010000:2.0:1788652307.193591:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007601e071/0x340ed74ef02a7899 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08a5 expref: 9 pid: 6678 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.193611:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007601e071/0x340ed74ef02a7899 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08a5 expref: 9 pid: 6678 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788652307.193619:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cbe4b190700 00000100:00100000:3.0:1788652307.200329:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652307.200429:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603621504 00000100:00100000:2.0:1788652307.200439:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603621504 00010000:00010000:2.0:1788652307.200475:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007601e071/0x340ed74ef02a7899 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08a5 expref: 9 pid: 6678 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652307.200525:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 36 00000100:00100000:2.0:1788652307.200537:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:2346:x1875537603621504:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652307.200551:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788652307.200575:0:5820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788652307.200578:0:5820:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788652305 00002000:00010000:2.0:1788652307.200581:0:5820:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788652305 00002000:00010000:2.0:1788652307.200583:0:5820:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788652305 00010000:00010000:2.0:1788652307.200589:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007601e071/0x340ed74ef02a7899 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08a5 expref: 9 pid: 6678 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.200602:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007601e071/0x340ed74ef02a7899 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08a5 expref: 9 pid: 6678 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.200637:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007601e071/0x340ed74ef02a7899 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08a5 expref: 9 pid: 6678 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.200655:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788652307.200660:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788652307.200666:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009ff5d6f6/0x340ed74ef02a78e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.200676:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ff5d6f6/0x340ed74ef02a78e6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.200714:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652307.200767:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2346:x1875537603621504:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 234us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652307.200819:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 36 00010000:00010000:1.0:1788652307.200889:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009ff5d6f6/0x340ed74ef02a78e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652307.200897:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ff5d6f6/0x340ed74ef02a78e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652307.200920:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ff5d6f6/0x340ed74ef02a78e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652307.200927:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ff5d6f6/0x340ed74ef02a78e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652307.200934:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ff5d6f6/0x340ed74ef02a78e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652307.200941:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e56400 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:1.0:1788652307.200945:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ff5d6f6/0x340ed74ef02a78e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652307.200954:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ff5d6f6/0x340ed74ef02a78e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652307.200978:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ff5d6f6/0x340ed74ef02a78e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652307.200985:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ff5d6f6/0x340ed74ef02a78e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652307.201028:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2346:x1875537603621248:12345-192.168.203.50@tcp:1:lfs.0 Request processed in 66189us (66417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652307.201036:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:1.0:1788652307.205122:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652307.205371:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603621760 00000100:00100000:2.0:1788652307.205382:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603621760 00000100:00100000:2.0:1788652307.205437:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:2.0:1788652307.205463:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+20:10285:x1875537603621760:12345-192.168.203.50@tcp:35:lfs.0 00000004:00010000:2.0:1788652307.205538:0:5838:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a78d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08c1 expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788652307.205864:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1788652307.205920:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788652307.206390:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788652307.206442:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a78ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.206458:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a787d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0897 expref: 24 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.206467:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a78ed lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.206511:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a787d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0897 expref: 24 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.206526:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a787d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0897 expref: 24 pid: 11683 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652307.206539:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b193480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5838:1875537627772416:192.168.203.50@tcp:104: 00000100:00100000:2.0:1788652307.206650:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b76acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652307.212328:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b193480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5838:1875537627772416:192.168.203.50@tcp:104: 00010000:00010000:2.0:1788652307.212360:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a78ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652307.213048:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652307.213169:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603621888 00000100:00100000:2.0:1788652307.213176:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603621888 00010000:00010000:2.0:1788652307.213210:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a787d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0897 expref: 25 pid: 11683 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652307.213246:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 37 00000100:00100000:2.0:1788652307.213263:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+25:2346:x1875537603621888:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652307.213284:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652307.213290:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a787d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0897 expref: 25 pid: 11683 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.213302:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a787d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0897 expref: 25 pid: 11683 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.213324:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a787d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0897 expref: 25 pid: 11683 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.213340:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe485acb00) 00010000:00010000:2.0:1788652307.213508:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a78ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.213520:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a78ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.213527:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a78ed lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.213560:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788652307.213618:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a78ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.213628:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a78ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652307.213706:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+24:2346:x1875537603621888:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 442us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652307.213715:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 37 00000001:00080000:0.0:1788652307.213755:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788652307.214069:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1788652307.214199:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4941ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5838:1875537627772544:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788652307.214302:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652307.214344:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b286000 going to sleep for 11 seconds 00000100:00100000:2.0:1788652307.214528:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627772544 00000100:00100000:2.0:1788652307.214534:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627772544 00000100:00100000:2.0:1788652307.214573:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788652307.214581:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4941b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1875537627772544:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788652307.214677:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4941b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1875537627772544:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 97us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652307.214684:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788652307.215632:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4941ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5838:1875537627772544:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788652307.217830:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1788652307.217928:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5838:1875537627772672:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788652307.217995:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652307.218040:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4502c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788652307.218637:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627772672 00000100:00100000:2.0:1788652307.218647:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627772672 00000100:00100000:2.0:1788652307.218705:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788652307.218715:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1875537627772672:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788652307.221020:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5838:x1875537627772672:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 2298us (3016us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788652307.221034:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788652307.221651:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5838:1875537627772672:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788652307.221745:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1788652307.221827:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a78ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652307.221838:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a78ed lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652307.221846:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a78ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652307.221866:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652307.221870:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a78ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652307.221879:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a78ed lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652307.221894:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe485acb00) 00010000:00010000:1.0:1788652307.221897:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788652307.221903:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a78ed lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652307.221910:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a78ed lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788652307.222127:0:5838:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788652307.222581:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788652307.222594:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 324205821547ns, next at 325205819338ns, rc = 0 00000001:00080000:1.0:1788652307.222602:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1788652307.222643:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe485acb00) 00010000:00010000:1.0:1788652307.222647:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788652307.222656:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a78d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08c1 expref: 28 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652307.222814:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+27:10285:x1875537603621760:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 17353us (17700us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788652307.222822:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 8 00000020:00080000:1.0:1788652307.222827:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788652307.228880:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652307.228925:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603622016 00000100:00100000:0.0:1788652307.228935:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603622016 00000100:00100000:0.0:1788652307.229011:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 45 00000100:00100000:0.0:1788652307.229021:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+27:10285:x1875537603622016:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1788652307.229046:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652307.229069:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a78f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f08c8 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.229139:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a78f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08c8 expref: 28 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.229154:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a78f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08c8 expref: 28 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.229174:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:0.0:1788652307.229177:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788652307.229181:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e57a00, rc 0) 00000100:00100000:0.0:1788652307.229240:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+28:10285:x1875537603622016:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 221us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652307.229248:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 45 00000100:00100000:3.0:1788652307.236024:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652307.236099:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603622272 00000100:00100000:1.0:1788652307.236108:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603622272 00000100:00100000:1.0:1788652307.236170:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:1.0:1788652307.236180:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe47b48450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+28:10285:x1875537603622272:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:1.0:1788652307.236813:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe47b48450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+29:10285:x1875537603622272:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 591us (755us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1788652307.236823:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:3.0:1788652307.324217:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652307.324666:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603622528 00000100:00100000:2.0:1788652307.324677:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603622528 00000100:00100000:2.0:1788652307.324817:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 46 00000100:00100000:2.0:1788652307.324828:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+29:10295:x1875537603622528:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1788652307.324852:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652307.324872:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a78fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f08cf expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652307.324954:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788652307.325075:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a78fb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08cf expref: 31 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.325102:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe48da0100) 00010000:00010000:2.0:1788652307.325105:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788652307.325213:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a78fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08cf expref: 31 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.325228:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215fc00, rc 0) 00000100:00100000:2.0:1788652307.325287:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+30:10295:x1875537603622528:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 461us (1080us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1788652307.325295:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 46 00000100:00100000:0.0:1788652307.332550:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652307.332637:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603622656 00000100:00100000:3.0:1788652307.332647:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603622656 00000100:00100000:3.0:1788652307.332705:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 47 00000100:00100000:3.0:1788652307.332716:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe49419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+30:10295:x1875537603622656:12345-192.168.203.50@tcp:34:lfs.0 00010000:00010000:3.0:1788652307.332813:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7909 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.332847:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7909 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.332860:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7909 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.332877:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7910 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.332885:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.332891:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.332978:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7917 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.332985:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.332992:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788652307.333036:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.333050:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7909 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.333069:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7909 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.333087:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7909 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.333093:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652307.333098:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7909 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.333105:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7909 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.333241:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:3.0:1788652307.333244:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652307.333250:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7909 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.333256:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7909 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.333270:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.333276:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7910 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.333282:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7910 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.333287:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652307.333290:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7910 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.333306:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7910 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.333314:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cbe7fde3400) 00010000:00010000:3.0:1788652307.333317:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652307.333320:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7910 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.333326:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7910 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.333341:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.333348:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7917 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.333353:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7917 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.333358:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652307.333361:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7917 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.333367:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7917 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.333373:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:3.0:1788652307.333375:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652307.333378:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7917 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.333393:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7917 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652307.333474:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe49419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+30:10295:x1875537603622656:12345-192.168.203.50@tcp:34:lfs.0 Request processed in 759us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652307.333483:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 47 00000100:00100000:3.0:1788652307.340335:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652307.340558:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603622912 00000100:00100000:0.0:1788652307.340568:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603622912 00000100:00100000:0.0:1788652307.340635:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:0.0:1788652307.340645:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+30:10295:x1875537603622912:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:0.0:1788652307.340952:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+31:10295:x1875537603622912:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 308us (626us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788652307.340960:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:0.0:1788652307.404401:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652307.404493:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603623168 00000100:00100000:3.0:1788652307.404517:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603623168 00000100:00100000:3.0:1788652307.404576:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 48 00000100:00100000:3.0:1788652307.404586:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4941bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+31:10298:x1875537603623168:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1788652307.404610:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652307.404630:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a791e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f08d6 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.404717:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7925 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.404732:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7925 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.404742:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7925 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.404757:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a792c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.404763:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a792c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.405117:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a792c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.405231:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a7933 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.405240:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a7933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.405246:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a7933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652307.405256:0:6701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788652307.405352:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7925 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.405360:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7925 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.405366:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7925 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.405372:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652307.405376:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7925 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.405384:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7925 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.405395:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:3.0:1788652307.405399:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652307.405410:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7925 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.405417:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7925 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.405430:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a792c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.405436:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a792c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.405441:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a792c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.405447:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652307.405450:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a792c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.405456:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a792c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.405463:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cbe7fde3400) 00010000:00010000:3.0:1788652307.405466:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652307.405469:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a792c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.405474:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a792c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.405525:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a791e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08d6 expref: 34 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.405553:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a7933 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08d6 expref: 33 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.405560:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:3.0:1788652307.405563:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788652307.405565:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5200, rc 0) 00000100:00100000:3.0:1788652307.405689:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4941bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+33:10298:x1875537603623168:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 1103us (1297us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1788652307.405698:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 48 00000100:00100000:0.0:1788652307.414855:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652307.414932:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603623296 00000100:00100000:3.0:1788652307.414943:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603623296 00000100:00100000:3.0:1788652307.415003:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00100000:3.0:1788652307.415014:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4941aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+33:10298:x1875537603623296:12345-192.168.203.50@tcp:54:lfs.0 00010000:00010000:3.0:1788652307.415084:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7941 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.415101:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.415112:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.415137:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.415145:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7941 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.415169:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7941 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.415175:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652307.415180:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7941 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.415189:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7941 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.415200:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:3.0:1788652307.415203:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788652307.415208:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7941 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652307.415214:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7941 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652307.415289:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4941aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+33:10298:x1875537603623296:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 276us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652307.415297:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00100000:2.0:1788652307.430526:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652307.430626:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603623552 00000100:00100000:0.0:1788652307.430636:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603623552 00000100:00100000:0.0:1788652307.430694:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:0.0:1788652307.430704:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+33:10298:x1875537603623552:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:0.0:1788652307.430983:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+34:10298:x1875537603623552:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 280us (484us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788652307.430992:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:0.0:1788652307.592421:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f82ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627772800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788652307.592492:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652307.592727:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627772800 00000100:00100000:1.0:1788652307.592736:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627772800 00000100:00100000:1.0:1788652307.592812:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788652307.592822:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe49419880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875537627772800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788652307.592843:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788652307.592900:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe49419880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875537627772800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652307.592907:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788652307.593034:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f82ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627772800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788652307.682811:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652307.682902:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603623808 00000100:00100000:2.0:1788652307.682912:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603623808 00000100:00100000:2.0:1788652307.682976:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 50 00000100:00100000:2.0:1788652307.682986:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe49419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+34:10329:x1875537603623808:12345-192.168.203.50@tcp:101:cat.0 00010000:00010000:2.0:1788652307.683011:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652307.683033:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7948 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f08dd expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.683132:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a794f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.683146:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a794f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.683157:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a794f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652307.683183:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788652307.683341:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7948 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08dd expref: 37 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.683360:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a794f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08dd expref: 36 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.683369:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:2.0:1788652307.683372:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788652307.683376:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215e200, rc 0) 00000100:00100000:2.0:1788652307.683438:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe49419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+36:10329:x1875537603623808:12345-192.168.203.50@tcp:101:cat.0 Request processed in 453us (669us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788652307.683446:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 50 00000100:00100000:2.0:1788652307.689124:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652307.689216:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603623936 00000100:00100000:0.0:1788652307.689227:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603623936 00000100:00100000:0.0:1788652307.689351:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:0.0:1788652307.689362:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51232050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+36:2348:x1875537603623936:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788652307.689378:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652307.689404:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a794f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08dd expref: 36 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.689423:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:0.0:1788652307.689429:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652307.689511:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51232050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+35:2348:x1875537603623936:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 150us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652307.689519:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:3.0:1788652307.690548:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652307.691559:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603624192 00000100:00100000:2.0:1788652307.691570:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603624192 00000100:00100000:2.0:1788652307.691820:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:2.0:1788652307.691832:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+35:10329:x1875537603624192:12345-192.168.203.50@tcp:35:cat.0 00000100:00100000:2.0:1788652307.692096:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+36:10329:x1875537603624192:12345-192.168.203.50@tcp:35:cat.0 Request processed in 265us (1552us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788652307.692103:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 12 00010000:00010000:2.0:1788652307.721386:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652307.784604:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652307.788637:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603624448 00000100:00100000:0.0:1788652307.788653:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603624448 00000100:00100000:0.0:1788652307.788730:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 51 00000100:00100000:0.0:1788652307.788743:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+36:10335:x1875537603624448:12345-192.168.203.50@tcp:101:dd.0 00010000:00010000:0.0:1788652307.788768:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652307.788805:0:6701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788652307.788832:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a78b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08b3 expref: 36 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.788853:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:0.0:1788652307.788858:0:6701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788652307.788873:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a795d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f08e4 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.788965:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a7964 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.788991:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a7933 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08d6 expref: 36 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.789002:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a7964 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.789039:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a7933 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08d6 expref: 36 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.789071:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a7933 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08d6 expref: 36 pid: 6701 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652307.789087:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4941b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6701:1875537627772928:192.168.203.50@tcp:104: 00000100:00100000:0.0:1788652307.789190:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b286a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788652307.794870:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652307.795091:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603624576 00000100:00100000:2.0:1788652307.795103:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603624576 00010000:00010000:2.0:1788652307.795157:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a7933 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08d6 expref: 37 pid: 6701 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652307.795230:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 38 00000100:00100000:2.0:1788652307.795242:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+37:2347:x1875537603624576:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652307.795261:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652307.795269:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a7933 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08d6 expref: 37 pid: 6701 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.795285:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a7933 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08d6 expref: 37 pid: 6701 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.795327:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:2.0:1788652307.795333:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a7964 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.795345:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a7964 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.795354:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a7964 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652307.795378:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652307.795446:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+37:2347:x1875537603624576:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 206us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652307.795454:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 38 00010000:00010000:0.0:1788652307.795733:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a7933 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08d6 expref: 36 pid: 6701 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652307.795753:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4941b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6701:1875537627772928:192.168.203.50@tcp:104: 00010000:00010000:0.0:1788652307.795988:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a7964 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.796001:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a7964 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.796008:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a7964 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652307.796086:0:6701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788652307.796298:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a795d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08e4 expref: 37 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.796443:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a7964 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08e4 expref: 36 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.796453:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:0.0:1788652307.796467:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788652307.796471:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e56400, rc 0) 00000100:00100000:0.0:1788652307.796599:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+36:10335:x1875537603624448:12345-192.168.203.50@tcp:101:dd.0 Request processed in 7858us (12009us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788652307.796609:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 51 00000100:00100000:1.0:1788652307.808426:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652307.808706:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603624832 00000100:00100000:0.0:1788652307.808719:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603624832 00000100:00100000:0.0:1788652307.808854:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 52 00000100:00100000:0.0:1788652307.808866:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+36:10335:x1875537603624832:12345-192.168.203.50@tcp:36:dd.0 00010000:00010000:0.0:1788652307.809480:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7972 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.809514:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7972 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652307.809528:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7972 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788652307.809590:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1788652307.809616:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f0dd755 reply state 000000007adf218f transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7972 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652307.809626:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788652307.809841:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+39:10335:x1875537603624832:12345-192.168.203.50@tcp:36:dd.0 Request processed in 974us (1425us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788652307.809849:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 52 00000020:00080000:0.0:1788652307.809856:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788652307.814283:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7972 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652307.814332:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7972 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652307.814341:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7972 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652307.814348:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e56e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652307.814355:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7972 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652307.814382:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7972 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652307.814404:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:1.0:1788652307.814408:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652307.814414:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7972 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652307.814422:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7972 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652308.095567:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652308.097394:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603624960 00000100:00100000:0.0:1788652308.097409:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603624960 00000100:00100000:0.0:1788652308.097508:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 53 00000100:00100000:0.0:1788652308.097535:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+38:10349:x1875537603624960:12345-192.168.203.50@tcp:101:stat.0 00010000:00010000:0.0:1788652308.097563:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652308.097587:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a7979 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f08eb expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.097656:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7980 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.097672:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7980 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.097694:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7980 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.097711:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7987 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.097718:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7987 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.097725:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7987 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.097914:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a798e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.097926:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a7964 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08e4 expref: 39 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.097935:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a798e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.097980:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a7964 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08e4 expref: 39 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.097995:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a7964 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08e4 expref: 39 pid: 6701 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652308.098008:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4941b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875537627773056:192.168.203.50@tcp:104: 00000100:00100000:0.0:1788652308.098125:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b286000 going to sleep for 11 seconds 00000100:00080000:2.0:1788652308.098637:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652308.105946:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652308.106438:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603625216 00000100:00100000:1.0:1788652308.106449:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603625216 00000100:00100000:1.0:1788652308.106515:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:1.0:1788652308.106525:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+40:5586:x1875537603625216:12345-192.168.203.50@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788652308.106911:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+41:5586:x1875537603625216:12345-192.168.203.50@tcp:35:ldlm_bl.0 Request processed in 385us (972us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1788652308.106920:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:0.0:1788652308.107105:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4941b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875537627773056:192.168.203.50@tcp:104: 00010000:00010000:0.0:1788652308.107129:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a798e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652308.112532:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652308.115241:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603625344 00000100:00100000:0.0:1788652308.115257:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603625344 00010000:00010000:0.0:1788652308.115473:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a7964 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08e4 expref: 41 pid: 6701 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652308.115615:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 39 00000100:00100000:0.0:1788652308.115627:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+41:2346:x1875537603625344:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788652308.115642:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652308.115649:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a7964 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08e4 expref: 41 pid: 6701 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.115663:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a7964 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08e4 expref: 41 pid: 6701 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.115707:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a7964 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08e4 expref: 41 pid: 6701 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.115723:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:0.0:1788652308.115728:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a798e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.115738:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a798e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.115745:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a798e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.115822:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652308.115876:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+40:2346:x1875537603625344:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 252us (3353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652308.115883:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 39 00010000:00010000:1.0:1788652308.116134:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a798e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.116144:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a798e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652308.116189:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788652308.116194:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788652308.116237:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a798e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.116259:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a798e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.116278:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7980 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.116284:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7980 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.116291:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7980 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.116296:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e56e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652308.116300:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7980 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.116318:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7980 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.116330:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:1.0:1788652308.116333:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652308.116337:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7980 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.116343:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7980 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.116354:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7987 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.116360:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7987 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.116372:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7987 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.116377:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151b600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652308.116380:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7987 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.116387:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7987 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.116395:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cbe48888100) 00010000:00010000:1.0:1788652308.116397:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652308.116400:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7987 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.116406:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7987 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.116444:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a7979 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08eb expref: 40 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.116459:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a798e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08eb expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.116467:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:1.0:1788652308.116469:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788652308.116472:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe4151a800, rc 0) 00000100:00100000:1.0:1788652308.116525:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+39:10349:x1875537603624960:12345-192.168.203.50@tcp:101:stat.0 Request processed in 18994us (20970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652308.116543:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 53 00000100:00100000:1.0:1788652308.202329:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652308.202648:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603625600 00000100:00100000:0.0:1788652308.202659:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603625600 00000100:00100000:0.0:1788652308.202720:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 54 00000100:00100000:0.0:1788652308.202731:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+39:10355:x1875537603625600:12345-192.168.203.50@tcp:36:truncate.0 00010000:00010000:0.0:1788652308.202827:0:6701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652308.202854:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a798e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08eb expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.202875:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:0.0:1788652308.202880:0:6701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788652308.203103:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7995 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.203116:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7995 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.203126:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7995 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788652308.203174:0:6701:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1788652308.203198:0:6701:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4c21494 reply state 000000002141e837 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7995 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652308.203207:0:6701:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788652308.203347:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+41:10355:x1875537603625600:12345-192.168.203.50@tcp:36:truncate.0 Request processed in 616us (1026us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788652308.203354:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 54 00000020:00080000:0.0:1788652308.203359:0:6701:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788652308.206207:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7995 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.206224:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7995 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.206232:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7995 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.206238:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151a600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652308.206253:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7995 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.206262:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7995 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.206297:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:0.0:1788652308.206300:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652308.206306:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7995 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.206314:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7995 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652308.425589:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652308.425691:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603625728 00000100:00100000:3.0:1788652308.425701:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603625728 00000100:00100000:3.0:1788652308.425807:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 55 00000100:00100000:3.0:1788652308.425820:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+40:10369:x1875537603625728:12345-192.168.203.50@tcp:101:stat.0 00010000:00010000:3.0:1788652308.425859:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652308.425879:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a799c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f08f2 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.425951:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a79a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.425967:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a79a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.425979:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a79a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.425994:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a79aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.426002:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a79aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.426008:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a79aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.426230:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a79b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.426239:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a79b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.426378:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a79b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652308.426415:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788652308.426425:0:11683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788652308.426456:0:11683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a79b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.426470:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a79b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.426479:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a79a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.426485:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a79a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.426502:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a79a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.426509:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652308.426513:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a79a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.426521:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a79a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.426534:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:3.0:1788652308.426537:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652308.426543:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a79a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.426550:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a79a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.426575:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a79aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.426592:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a79aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.426598:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a79aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.426603:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652308.426606:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a79aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.426612:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a79aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.426621:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cbe7fde3400) 00010000:00010000:3.0:1788652308.426624:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652308.426627:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a79aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.426633:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a79aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.426665:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a799c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08f2 expref: 42 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.426679:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a79b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08f2 expref: 41 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.426686:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:3.0:1788652308.426688:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788652308.426696:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5c00, rc 0) 00000100:00100000:3.0:1788652308.427116:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+41:10369:x1875537603625728:12345-192.168.203.50@tcp:101:stat.0 Request processed in 1296us (1542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652308.427125:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 55 00000100:00100000:3.0:1788652308.533171:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652308.533302:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603625984 00000100:00100000:1.0:1788652308.533312:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603625984 00000100:00100000:1.0:1788652308.533425:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 56 00000100:00100000:1.0:1788652308.533436:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+41:10379:x1875537603625984:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1788652308.533457:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652308.533478:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924e00/0x340ed74ef02a79b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f08f9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652308.533591:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788652308.533716:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924e00/0x340ed74ef02a79b8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08f9 expref: 43 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.533732:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe48da0100) 00010000:00010000:1.0:1788652308.533735:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788652308.533740:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924e00/0x340ed74ef02a79b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08f9 expref: 43 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.534008:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe52924e00, rc 0) 00000100:00100000:1.0:1788652308.534128:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+42:10379:x1875537603625984:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 693us (964us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1788652308.534136:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 56 00000100:00100000:0.0:1788652308.549239:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652308.549563:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603626240 00000100:00100000:2.0:1788652308.549574:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603626240 00000100:00100000:2.0:1788652308.549638:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00100000:2.0:1788652308.549662:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4941b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+42:10379:x1875537603626240:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:2.0:1788652308.549945:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4941b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+43:10379:x1875537603626240:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 284us (715us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788652308.549953:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00100000:2.0:1788652308.610591:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652308.610710:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603626496 00000100:00100000:1.0:1788652308.610720:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603626496 00000100:00100000:1.0:1788652308.611165:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00100000:1.0:1788652308.611176:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+43:10385:x1875537603626496:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:1.0:1788652308.611201:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652308.611223:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924e00/0x340ed74ef02a79c6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0900 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.612334:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a79cd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.612358:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a79b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08f2 expref: 44 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.612368:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a79cd lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.612413:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a79b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08f2 expref: 44 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.612431:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a79b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08f2 expref: 44 pid: 11683 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652308.612445:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f82dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875537627773184:192.168.203.50@tcp:104: 00000100:00100000:1.0:1788652308.612583:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4502c540 going to sleep for 11 seconds 00000100:00100000:2.0:1788652308.616346:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788652308.616371:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe513b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627773312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788652308.616447:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652308.616632:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652308.616711:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f82dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875537627773184:192.168.203.50@tcp:104: 00010000:00010000:1.0:1788652308.616735:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a79cd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652308.616944:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603626624 00000100:00100000:3.0:1788652308.616952:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603626624 00010000:00010000:3.0:1788652308.616988:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a79b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08f2 expref: 45 pid: 11683 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652308.617078:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 40 00000100:00100000:3.0:1788652308.617089:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+45:2347:x1875537603626624:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652308.617103:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652308.617111:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a79b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08f2 expref: 45 pid: 11683 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.617124:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a79b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08f2 expref: 45 pid: 11683 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.617148:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a79b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08f2 expref: 45 pid: 11683 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.617162:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:3.0:1788652308.617167:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a79cd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.617178:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a79cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.617254:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a79cd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.617354:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652308.617399:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+44:2347:x1875537603626624:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 312us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652308.617407:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 40 00010000:00010000:1.0:1788652308.617453:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a79cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.617467:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a79cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652308.617486:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788652308.617643:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924e00/0x340ed74ef02a79c6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0900 expref: 45 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.617659:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a79cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0900 expref: 44 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.617667:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:1.0:1788652308.617670:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788652308.617673:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe52925c00, rc 0) 00000100:00100000:1.0:1788652308.617698:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+44:10385:x1875537603626496:12345-192.168.203.50@tcp:101:bash.0 Request processed in 6525us (7117us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1788652308.617705:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00100000:0.0:1788652308.618646:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627773312 00000100:00100000:0.0:1788652308.618656:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627773312 00000100:00100000:0.0:1788652308.618751:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788652308.618796:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627773312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788652308.618830:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788652308.618892:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627773312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (2444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652308.618898:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788652308.619021:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe513b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627773312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788652308.625300:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652308.625418:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603626880 00000100:00100000:3.0:1788652308.625427:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603626880 00000100:00100000:3.0:1788652308.625480:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 58 00000100:00100000:3.0:1788652308.625499:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe49419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+44:10385:x1875537603626880:12345-192.168.203.50@tcp:36:bash.0 00010000:00010000:3.0:1788652308.628575:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a79db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.628604:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a79db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.628620:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a79db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788652308.628751:0:11683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1788652308.628832:0:11683:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f239aa98 reply state 00000000f948d21f transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a79db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652308.628842:0:11683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788652308.628972:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe49419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+47:10385:x1875537603626880:12345-192.168.203.50@tcp:36:bash.0 Request processed in 3480us (3679us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788652308.628998:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 58 00000020:00080000:3.0:1788652308.629004:0:11683:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788652308.634281:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a79db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.634298:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a79db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.634307:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a79db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.634313:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652308.634318:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a79db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.634327:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a79db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.634344:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:3.0:1788652308.634347:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652308.634353:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a79db lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.634360:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a79db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652308.636107:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652308.636396:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603627008 00000100:00100000:1.0:1788652308.636406:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603627008 00000100:00100000:1.0:1788652308.636465:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 59 00000100:00100000:1.0:1788652308.636476:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe49418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+46:10385:x1875537603627008:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:1.0:1788652308.636507:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652308.636532:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924e00/0x340ed74ef02a79e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0907 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.636610:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925200/0x340ed74ef02a79e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.636641:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a79cd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0900 expref: 47 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.636650:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925200/0x340ed74ef02a79e9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.636681:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a79cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0900 expref: 47 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.636694:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a79cd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0900 expref: 47 pid: 5836 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652308.636706:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f82dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875537627773440:192.168.203.50@tcp:104: 00000100:00100000:1.0:1788652308.636999:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4502ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788652308.662993:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652308.663162:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603627136 00000100:00100000:2.0:1788652308.663171:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603627136 00010000:00010000:2.0:1788652308.663211:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a79cd lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0900 expref: 48 pid: 5836 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652308.663267:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 41 00000100:00100000:2.0:1788652308.663458:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+48:2347:x1875537603627136:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652308.663474:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652308.663480:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a79cd lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0900 expref: 48 pid: 5836 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652308.663502:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a79cd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0900 expref: 48 pid: 5836 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652308.663529:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:2.0:1788652308.663534:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925200/0x340ed74ef02a79e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652308.663565:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925200/0x340ed74ef02a79e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652308.663573:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925200/0x340ed74ef02a79e9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652308.663593:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788652308.663840:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a79cd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0900 expref: 48 pid: 5836 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652308.663858:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f82dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875537627773440:192.168.203.50@tcp:104: 00010000:00010000:0.0:1788652308.663878:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925200/0x340ed74ef02a79e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.663887:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925200/0x340ed74ef02a79e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.663901:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925200/0x340ed74ef02a79e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652308.663945:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788652308.663949:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788652308.663973:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925200/0x340ed74ef02a79e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.664001:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924e00/0x340ed74ef02a79e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0907 expref: 48 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.664015:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925200/0x340ed74ef02a79e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0907 expref: 47 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.664023:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:0.0:1788652308.664025:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788652308.664028:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe52925200, rc 0) 00000100:00100000:2.0:1788652308.664222:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+47:2347:x1875537603627136:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 945us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652308.664231:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 41 00000100:00100000:0.0:1788652308.666036:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe49418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+46:10385:x1875537603627008:12345-192.168.203.50@tcp:101:bash.0 Request processed in 29551us (29928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652308.666058:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 59 00000100:00100000:2.0:1788652308.670731:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652308.671136:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603627392 00000100:00100000:1.0:1788652308.671147:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603627392 00000100:00100000:1.0:1788652308.671256:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00100000:1.0:1788652308.671266:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe47b48c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+46:10385:x1875537603627392:12345-192.168.203.50@tcp:35:bash.0 00000100:00100000:1.0:1788652308.671547:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe47b48c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+47:10385:x1875537603627392:12345-192.168.203.50@tcp:35:bash.0 Request processed in 281us (824us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1788652308.671555:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 15 00010000:00010000:3.0:1788652308.743937:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652308.749740:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652308.749808:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603627648 00000100:00100000:0.0:1788652308.749818:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603627648 00000100:00100000:0.0:1788652308.749873:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 60 00000100:00100000:0.0:1788652308.749883:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4941a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+47:10395:x1875537603627648:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1788652308.749908:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652308.749930:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a79f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f090e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652308.750607:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788652308.750747:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a79f0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f090e expref: 49 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.750763:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe48da0100) 00010000:00010000:0.0:1788652308.750766:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788652308.750810:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a79f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f090e expref: 49 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.750827:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe4151a400, rc 0) 00000100:00100000:0.0:1788652308.750885:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4941a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+48:10395:x1875537603627648:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 1003us (1153us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1788652308.750893:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 60 00000100:00100000:2.0:1788652308.763911:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652308.764065:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603627776 00000100:00100000:3.0:1788652308.764079:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603627776 00000100:00100000:3.0:1788652308.764152:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 61 00000100:00100000:3.0:1788652308.764164:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+48:10395:x1875537603627776:12345-192.168.203.50@tcp:34:lfs.0 00010000:00010000:3.0:1788652308.764438:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a79fe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.764461:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a79fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.764547:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a79fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.764566:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7a05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.764574:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7a05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.764580:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7a05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.764684:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7a0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.764692:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.764699:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788652308.764763:0:11683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.764823:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a79fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.764844:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a79fe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.764851:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a79fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.764857:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652308.764862:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a79fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.764870:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a79fe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.764883:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:3.0:1788652308.764886:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652308.764891:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a79fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.764898:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a79fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.764914:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7a05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.764920:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7a05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.764925:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7a05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.764930:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652308.764941:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7a05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.764948:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7a05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.764958:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cbe7fde3700) 00010000:00010000:3.0:1788652308.764960:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652308.764963:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7a05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.764970:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7a05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.764987:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.764992:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7a0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.764997:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7a0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.765002:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652308.765005:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7a0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.765012:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7a0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.765019:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:3.0:1788652308.765021:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652308.765031:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7a0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.765037:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7a0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652308.765233:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+48:10395:x1875537603627776:12345-192.168.203.50@tcp:34:lfs.0 Request processed in 1069us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652308.765314:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 61 00000100:00100000:2.0:1788652308.770981:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652308.771207:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603628032 00000100:00100000:3.0:1788652308.771220:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603628032 00000100:00100000:3.0:1788652308.771296:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:3.0:1788652308.771310:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+48:10395:x1875537603628032:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:3.0:1788652308.771940:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+49:10395:x1875537603628032:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 633us (972us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788652308.771951:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:0.0:1788652308.813133:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652308.813307:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603628288 00000100:00100000:1.0:1788652308.813321:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603628288 00000100:00100000:1.0:1788652308.813392:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 62 00000100:00100000:1.0:1788652308.813403:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe49418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+49:10398:x1875537603628288:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1788652308.813451:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652308.813482:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924e00/0x340ed74ef02a7a13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0915 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.813593:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a7a1a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.813611:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a7a1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.813626:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a7a1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.813644:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924200/0x340ed74ef02a7a21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.813651:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924200/0x340ed74ef02a7a21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.813657:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924200/0x340ed74ef02a7a21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.814006:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a7a28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.814018:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a7a28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.814025:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a7a28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652308.814038:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788652308.814239:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a7a1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.814248:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a7a1a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.814377:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a7a1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.814384:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe52925c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652308.814390:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a7a1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.814399:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a7a1a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.814414:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:1.0:1788652308.814417:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652308.814422:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a7a1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.814429:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925c00/0x340ed74ef02a7a1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.814448:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924200/0x340ed74ef02a7a21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.814455:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924200/0x340ed74ef02a7a21 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.814462:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924200/0x340ed74ef02a7a21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.814467:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe52924200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652308.814477:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924200/0x340ed74ef02a7a21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.814484:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924200/0x340ed74ef02a7a21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.814502:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cbe48da0000) 00010000:00010000:1.0:1788652308.814505:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652308.814509:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924200/0x340ed74ef02a7a21 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.814515:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924200/0x340ed74ef02a7a21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.814574:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924e00/0x340ed74ef02a7a13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0915 expref: 52 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.814590:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a7a28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0915 expref: 51 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.814598:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:1.0:1788652308.814600:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788652308.814603:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c8a00, rc 0) 00000100:00100000:1.0:1788652308.814743:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe49418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+51:10398:x1875537603628288:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 1340us (1623us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1788652308.814752:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 62 00000100:00100000:2.0:1788652308.819213:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652308.819280:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652308.819429:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603628544 00000100:00100000:1.0:1788652308.819443:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603628544 00000100:00100000:1.0:1788652308.819539:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:1.0:1788652308.819553:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+51:2349:x1875537603628544:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652308.819594:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652308.819628:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a7a28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0915 expref: 51 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.819651:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:1.0:1788652308.819658:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652308.819724:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+50:2349:x1875537603628544:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 175us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652308.819744:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:0.0:1788652308.819898:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603628416 00000100:00100000:0.0:1788652308.819903:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603628416 00000100:00100000:0.0:1788652308.819944:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 63 00000100:00100000:0.0:1788652308.819952:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+50:10398:x1875537603628416:12345-192.168.203.50@tcp:54:lfs.0 00010000:00010000:0.0:1788652308.820030:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7a36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.820058:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.820070:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.820116:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7a36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.820123:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7a36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.820131:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7a36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.820137:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151ac00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652308.820142:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7a36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.820151:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7a36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.820160:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:0.0:1788652308.820163:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788652308.820166:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7a36 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652308.820172:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7a36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652308.820214:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+50:10398:x1875537603628416:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 263us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652308.820221:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 63 00000100:00100000:2.0:1788652308.830623:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652308.830719:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603628800 00000100:00100000:1.0:1788652308.830851:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603628800 00000100:00100000:1.0:1788652308.830958:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:1.0:1788652308.830970:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+50:10398:x1875537603628800:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:1.0:1788652308.831554:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+51:10398:x1875537603628800:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 583us (942us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788652308.831563:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:0.0:1788652308.972078:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652308.972251:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603629056 00000100:00100000:3.0:1788652308.972264:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603629056 00000100:00100000:3.0:1788652308.972442:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 64 00000100:00100000:3.0:1788652308.972456:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe49418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+51:10416:x1875537603629056:12345-192.168.203.50@tcp:101:cat.0 00010000:00010000:3.0:1788652308.972504:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652308.972533:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7a3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f091c expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.972673:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7a44 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.972692:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7a44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.972729:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7a44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652308.972744:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788652308.973080:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7a3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f091c expref: 54 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.973104:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7a44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f091c expref: 53 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652308.973114:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:3.0:1788652308.973117:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788652308.973121:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5c00, rc 0) 00000100:00100000:3.0:1788652308.973374:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe49418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+53:10416:x1875537603629056:12345-192.168.203.50@tcp:101:cat.0 Request processed in 920us (1309us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788652308.973383:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 64 00000100:00100000:2.0:1788652308.996933:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652308.997248:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603629184 00000100:00100000:1.0:1788652308.997263:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603629184 00000100:00100000:1.0:1788652308.997348:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 65 00000100:00100000:1.0:1788652308.997361:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+53:10417:x1875537603629184:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1788652308.997393:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652308.997420:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a7a52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0923 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.997523:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a7a59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.997565:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a7a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.997580:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a7a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652308.997626:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788652308.997630:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788652308.997651:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a7a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.997692:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a7a52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0923 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.997716:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a7a59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0923 expref: 54 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652308.997727:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:1.0:1788652308.997730:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788652308.997734:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c8e00, rc 0) 00000100:00100000:1.0:1788652308.997859:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+54:10417:x1875537603629184:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 502us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652308.997866:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 65 00000100:00100000:2.0:1788652309.004435:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652309.004526:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603629568 00000100:00100000:3.0:1788652309.004540:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603629568 00000100:00100000:3.0:1788652309.004648:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:3.0:1788652309.004660:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+54:10417:x1875537603629568:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:3.0:1788652309.005145:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+55:10417:x1875537603629568:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 485us (846us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788652309.005153:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:0.0:1788652309.007444:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652309.008156:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603629696 00000100:00100000:2.0:1788652309.008170:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603629696 00000100:00100000:1.0:1788652309.008352:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:1.0:1788652309.008368:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4941b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+55:10417:x1875537603629696:12345-192.168.203.50@tcp:103:lfs.0 00010000:00010000:1.0:1788652309.008386:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788652309.008420:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925200/0x340ed74ef02a79e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0907 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.008473:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7a44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f091c expref: 54 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.008506:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a78f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f08c8 expref: 53 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.008523:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48888400) 00010000:00010000:1.0:1788652309.008538:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652309.008620:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4941b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+52:10417:x1875537603629696:12345-192.168.203.50@tcp:103:lfs.0 Request processed in 256us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652309.008629:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:2.0:1788652309.011238:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652309.011849:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603629824 00000100:00100000:1.0:1788652309.011862:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603629824 00000100:00100000:1.0:1788652309.012034:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 66 00000100:00100000:1.0:1788652309.012046:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+52:10417:x1875537603629824:12345-192.168.203.50@tcp:58:lfs.0 00010000:00010000:1.0:1788652309.012178:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a7a60 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.012198:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a7a60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.012211:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a7a60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788652309.012587:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788652309.013035:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788652309.013110:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788652309.013250:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+52:10417:x1875537603629824:12345-192.168.203.50@tcp:58:lfs.0 Request processed in 1204us (2023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652309.013260:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 66 00000100:00100000:2.0:1788652309.032120:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652309.032199:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603629952 00000100:00100000:3.0:1788652309.032210:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603629952 00000100:00100000:3.0:1788652309.032280:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 67 00000100:00100000:3.0:1788652309.032300:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+52:10419:x1875537603629952:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1788652309.032354:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652309.032376:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7a67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f092a expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032447:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7a6e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032463:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7a6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032476:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7a6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032500:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7a75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032507:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7a75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032513:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7a75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032600:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7a7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032609:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032615:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652309.032649:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788652309.032660:0:11683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788652309.032681:0:11683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032704:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032714:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7a6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032720:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7a6e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032728:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7a6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032735:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652309.032739:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7a6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032747:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7a6e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032758:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:3.0:1788652309.032761:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652309.032766:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7a6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032813:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7a6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032825:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7a75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032841:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7a75 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032846:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7a75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032853:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652309.032856:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7a75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032864:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7a75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032873:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cbe7fde3700) 00010000:00010000:3.0:1788652309.032876:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652309.032879:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7a75 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032884:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7a75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032917:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7a67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f092a expref: 54 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032929:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7a7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f092a expref: 53 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.032937:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48da0000) 00010000:00010000:3.0:1788652309.032939:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788652309.032948:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e4c00, rc 0) 00000100:00100000:2.0:1788652309.033288:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+53:10419:x1875537603629952:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 997us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652309.033365:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 67 00000001:00080000:0.0:1788652309.197428:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967345 is committed 00000001:00080000:0.0:1788652309.197682:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967348 is committed 00000004:00080000:0.0:1788652309.197768:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788652309.201850:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627773568:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788652309.201923:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652309.202004:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627773568 00000100:00100000:3.0:1788652309.202011:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627773568 00000100:00100000:3.0:1788652309.202076:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788652309.202087:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875537627773568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788652309.202112:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1788652309.202147:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9cab11, atime: 0x6a9cab11, ctime: 0x6a9cab11, blocks: 0x1 00010000:00010000:3.0:1788652309.202155:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006842fa17/0x340ed74ef02a7a83 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.202172:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=326s v=(0 0) 00010000:00010000:3.0:1788652309.202176:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652309.202183:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006842fa17/0x340ed74ef02a7a83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.202202:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006842fa17/0x340ed74ef02a7a83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.202212:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006842fa17/0x340ed74ef02a7a83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.202220:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006842fa17/0x340ed74ef02a7a83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.202247:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788652309.202821:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1875537627773568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 733us (894us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788652309.202830:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788652309.202861:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652309.202867:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006842fa17/0x340ed74ef02a7a83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.202877:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5000 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:3.0:1788652309.202881:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006842fa17/0x340ed74ef02a7a83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.202892:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006842fa17/0x340ed74ef02a7a83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.202908:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006842fa17/0x340ed74ef02a7a83 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.202918:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006842fa17/0x340ed74ef02a7a83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.202937:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652309.202939:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652309.202941:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788652309.202972:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cbe7f2c3b80/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788652309.202978:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627773568:0@lo:6:osp-syn-1-0.0 00000100:00080000:2.0:1788652309.203108:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:0.0:1788652309.203344:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cbe4502c000 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788652309.203349:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbe42e46f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cbe4502c240 00000020:00080000:0.0:1788652309.203352:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbe42e46600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cbe4927f800 00000020:00080000:2.0:1788652309.203520:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000001:00080000:0.0:1788652309.203577:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000020:00080000:2.0:1788652309.203609:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:3.0:1788652309.322680:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788652309.322689:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788652309.322759:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788652309.322767:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788652309.326689:0:11670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1875537627773696:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788652309.326814:0:11670:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b76ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788652309.331725:0:11670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1875537627773696:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788652309.335200:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652309.335462:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603630080 00000100:00100000:3.0:1788652309.335526:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603630080 00000100:00100000:3.0:1788652309.335580:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 1 00000100:00100000:3.0:1788652309.335591:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+11:10430:x1875537603630080:12345-192.168.203.50@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788652309.335678:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+11:10430:x1875537603630080:12345-192.168.203.50@tcp:900:lhsmtool_posix.0 Request processed in 87us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652309.335685:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 1 00000100:00100000:2.0:1788652309.339029:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652309.339364:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603630208 00000100:00100000:0.0:1788652309.339374:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603630208 00000100:00100000:0.0:1788652309.339481:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 68 00000100:00100000:0.0:1788652309.339503:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+11:10430:x1875537603630208:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788652309.339546:0:5835:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788652309.339648:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+11:10430:x1875537603630208:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 149us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652309.339656:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 68 00000100:00100000:0.0:1788652309.347923:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652309.349977:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603630336 00000100:00100000:2.0:1788652309.349991:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603630336 00000100:00100000:2.0:1788652309.350147:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 69 00000100:00100000:2.0:1788652309.350159:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4941b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+11:10430:x1875537603630336:12345-192.168.203.50@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788652309.350244:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7a8a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350262:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7a8a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350275:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7a8a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350293:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7a91 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350300:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7a91 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350307:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7a91 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350333:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7a98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350340:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350364:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652309.350404:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788652309.350408:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788652309.350425:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350436:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7a8a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350443:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7a8a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350450:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7a8a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350456:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215fa00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652309.350460:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7a8a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350479:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7a8a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350501:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbe7fde3200) 00010000:00010000:2.0:1788652309.350504:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652309.350508:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7a8a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350514:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7a8a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350538:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7a91 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350545:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7a91 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350551:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7a91 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350556:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652309.350559:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7a91 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350565:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7a91 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350590:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8cbe485ac200) 00010000:00010000:2.0:1788652309.350593:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652309.350596:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7a91 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350603:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7a91 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350617:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350623:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7a98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350629:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7a98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350640:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652309.350642:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7a98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350648:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7a98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350656:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48da0000) 00010000:00010000:2.0:1788652309.350658:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652309.350661:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7a98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.350666:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7a98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652309.350739:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4941b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+11:10430:x1875537603630336:12345-192.168.203.50@tcp:34:lhsmtool_posix.0 Request processed in 581us (2824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652309.350746:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 69 00000100:00100000:1.0:1788652309.362864:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652309.362949:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603630592 00000100:00100000:0.0:1788652309.362959:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603630592 00000100:00100000:0.0:1788652309.363016:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 70 00000100:00100000:0.0:1788652309.363036:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+11:10430:x1875537603630592:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788652309.363072:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652309.363095:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7a9f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0931 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.363419:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7aa6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.363451:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.363473:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652309.363500:0:6701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788652309.363684:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.363692:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7aa6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.363700:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.363705:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151a600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652309.363710:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.363717:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7aa6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.363728:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48da0000) 00010000:00010000:0.0:1788652309.363730:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788652309.363734:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7aa6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.363741:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7aa6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.363810:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7a9f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0931 expref: 13 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.363827:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbe7fde3200) 00010000:00010000:0.0:1788652309.363830:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788652309.363834:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7a9f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0931 expref: 13 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.363845:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe4151b600, rc 0) 00000100:00100000:0.0:1788652309.363905:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+12:10430:x1875537603630592:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 872us (1051us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1788652309.363914:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 70 00000100:00100000:1.0:1788652309.368559:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652309.369851:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603630720 00000100:00100000:0.0:1788652309.369982:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603630720 00000100:00100000:0.0:1788652309.370271:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 71 00000100:00100000:0.0:1788652309.370284:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+12:10430:x1875537603630720:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788652309.370319:0:5835:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788652309.370430:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+12:10430:x1875537603630720:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 148us (1880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652309.370438:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 71 00000100:00100000:1.0:1788652309.396522:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652309.396670:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603630976 00000100:00100000:3.0:1788652309.396679:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603630976 00000100:00100000:3.0:1788652309.396743:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 72 00000100:00100000:3.0:1788652309.396753:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+12:10430:x1875537603630976:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788652309.396810:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652309.396813:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788652309.396838:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a7a59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0923 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.396856:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:3.0:1788652309.396862:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788652309.396876:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7ab4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0938 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788652309.399227:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788652309.399744:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7abb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.399762:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7abb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.399909:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7abb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.399985:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7ab4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0938 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.400004:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7abb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0938 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.400013:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cbe7fde3700) 00010000:00010000:3.0:1788652309.400017:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788652309.400308:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e4400, rc 0) 00000100:00100000:3.0:1788652309.400429:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+13:10430:x1875537603630976:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 3675us (3913us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788652309.400439:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 72 00000100:00100000:1.0:1788652309.406125:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652309.406179:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603631232 00000100:00100000:0.0:1788652309.406189:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603631232 00000100:00100000:0.0:1788652309.406248:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 73 00000100:00100000:0.0:1788652309.406257:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+13:10430:x1875537603631232:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788652309.406381:0:6701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652309.406406:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7abb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0938 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.406436:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cbe7fde3700) 00010000:00010000:0.0:1788652309.406459:0:6701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788652309.406481:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7ac9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.406648:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7ac9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.406947:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7ac9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.407199:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a7ad0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x4dc3b67c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.407210:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a7ad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4dc3b67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.407218:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a7ad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4dc3b67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.407647:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7ac9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.407656:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7ac9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.407662:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7ac9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.407669:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151b600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652309.407673:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7ac9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.407680:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7ac9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.407699:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:1.0:1788652309.407702:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652309.407706:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7ac9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.407713:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7ac9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.407968:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a7ad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4dc3b67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.407977:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a7ad0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4dc3b67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.407983:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a7ad0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4dc3b67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.407988:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c8c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652309.407991:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a7ad0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4dc3b67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.407998:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a7ad0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4dc3b67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.408008:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x4dc3b67c (ffff8cbe48da0c00) 00010000:00010000:1.0:1788652309.408010:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652309.408013:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a7ad0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4dc3b67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.408019:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a7ad0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4dc3b67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652309.408575:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+12:10430:x1875537603631232:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 2314us (2818us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788652309.408584:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 73 00000100:00100000:1.0:1788652309.413885:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652309.413963:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603631360 00000100:00100000:0.0:1788652309.413972:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603631360 00000100:00100000:0.0:1788652309.414032:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 74 00000100:00100000:0.0:1788652309.414051:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+12:10430:x1875537603631360:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788652309.414073:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652309.414132:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7ad7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f093f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.414174:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7ade lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.414188:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.414200:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.414372:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7ad7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f093f expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.414583:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f093f expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.414596:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cbe48888900) 00010000:00010000:0.0:1788652309.414599:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788652309.414604:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe4151ac00, rc 0) 00000100:00100000:0.0:1788652309.416084:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+13:10430:x1875537603631360:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 2034us (2199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652309.416098:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 74 00000100:00100000:0.0:1788652309.424208:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652309.424363:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603631616 00000100:00100000:1.0:1788652309.424373:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603631616 00000100:00100000:1.0:1788652309.424585:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 75 00000100:00100000:1.0:1788652309.424597:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4941ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+13:10430:x1875537603631616:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788652309.424679:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7ae5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.424697:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7ae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.424710:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7ae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788652309.425017:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1788652309.425029:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 326408256235ns, next at 327408254085ns, rc = 0 00000004:00010000:1.0:1788652309.425116:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002313afeb reply state 000000006cf2f4f1 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7ae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652309.425126:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788652309.425234:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4941ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+15:10430:x1875537603631616:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 638us (1033us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1788652309.425900:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 75 00010000:00010000:2.0:1788652309.431135:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7ae5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.431153:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7ae5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.431161:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7ae5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.431167:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652309.431171:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7ae5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.431195:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7ae5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.431211:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cbe48888900) 00010000:00010000:2.0:1788652309.431215:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788652309.431221:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7ae5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.431227:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7ae5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652309.432861:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652309.433052:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603631744 00000100:00100000:2.0:1788652309.433061:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603631744 00000100:00100000:2.0:1788652309.433113:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 76 00000100:00100000:2.0:1788652309.433124:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+14:10430:x1875537603631744:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788652309.433150:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652309.433171:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7aec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0946 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.433228:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7aec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0946 expref: 15 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.433248:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7aec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0946 expref: 15 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.433268:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cbe48888900) 00010000:00010000:2.0:1788652309.433271:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788652309.433275:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215e400, rc 0) 00000100:00100000:2.0:1788652309.433350:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+15:10430:x1875537603631744:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 227us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652309.433357:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 76 00000100:00100000:1.0:1788652309.442620:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652309.442710:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603631872 00000100:00100000:2.0:1788652309.442720:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603631872 00000100:00100000:2.0:1788652309.442763:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 25 00000100:00100000:2.0:1788652309.442797:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1875537603631872:12345-192.168.203.50@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788652309.442829:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp t0 exp 0000000000000000 cur 326 last 0 00000020:00000080:2.0:1788652309.442860:0:6679:0:(genops.c:1385:class_connect()) connect: client 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c, cookie 0x340ed74ef02a7af3 00002000:00100000:2.0:1788652309.442871:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c/ffff8cbe48683000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788652309.442880:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788652309.443111:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788652309.443142:0:6679:0:(import.c:65:import_set_state_nolock()) ffff8cbe48687000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788652309.443209:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2345:x1875537603631872:12345-192.168.203.50@tcp:8:lhsmtool_posix.0 Request processed in 437us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652309.443217:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 25 00000100:00100000:1.0:1788652309.474291:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652309.474362:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603632000 00000100:00100000:3.0:1788652309.474372:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603632000 00000100:00100000:3.0:1788652309.474451:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 26 00000100:00100000:3.0:1788652309.474462:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:0:x1875537603632000:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788652309.475989:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788652309.517976:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:0:x1875537603632000:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 Request processed in 43505us (43684us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788652309.517990:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 26 00000001:00100000:0.0:1788652309.520917:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c 00000001:00080000:0.0:1788652309.520939:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:3.0:1788652309.521789:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652309.521864:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603632256 00000100:00100000:1.0:1788652309.521875:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603632256 00000100:00100000:1.0:1788652309.521923:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:1.0:1788652309.521933:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+15:10430:x1875537603632256:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788652309.522215:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+16:10430:x1875537603632256:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 283us (448us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788652309.522223:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:1.0:1788652309.524022:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652309.524146:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603632512 00000100:00100000:2.0:1788652309.524156:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603632512 00000100:00100000:2.0:1788652309.524216:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 77 00000100:00100000:2.0:1788652309.524225:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+16:10430:x1875537603632512:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788652309.524323:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+16:10430:x1875537603632512:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 98us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652309.524344:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 77 00000100:00100000:1.0:1788652309.527230:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652309.528972:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603632640 00000100:00100000:3.0:1788652309.528985:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603632640 00000100:00100000:3.0:1788652309.529043:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 78 00000100:00100000:3.0:1788652309.529053:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+16:10430:x1875537603632640:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788652309.529073:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652309.529093:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7afa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f094d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.529172:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7b01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.531637:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.531660:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652309.531706:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788652309.531728:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.531768:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7afa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f094d expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.531800:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7b01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f094d expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.531810:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cbe48888900) 00010000:00010000:3.0:1788652309.531813:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788652309.531817:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5000, rc 0) 00000100:00100000:3.0:1788652309.531894:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+17:10430:x1875537603632640:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 2841us (4673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652309.531903:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 78 00000100:00100000:3.0:1788652309.537285:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652309.537354:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603632768 00000100:00100000:2.0:1788652309.537365:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603632768 00000100:00100000:2.0:1788652309.537422:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 27 00000100:00100000:2.0:1788652309.537432:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2347:x1875537603632768:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788652309.537450:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652309.537490:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7de7351/0x340ed74ef02a7b08 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0954 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788652309.537517:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cab14, blocks: 0x1 00010000:00010000:2.0:1788652309.537535:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=326s v=(0 0) 00010000:00010000:2.0:1788652309.537541:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652309.537749:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7de7351/0x340ed74ef02a7b08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0954 expref: 6 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.537838:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f7de7351/0x340ed74ef02a7b08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0954 expref: 6 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.537853:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215e200, rc 0) 00000100:00100000:2.0:1788652309.537910:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2347:x1875537603632768:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 479us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652309.537917:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 27 00000100:00100000:3.0:1788652309.543061:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652309.543184:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603633024 00000100:00100000:0.0:1788652309.543194:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603633024 00000100:00100000:0.0:1788652309.543255:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 79 00000100:00100000:0.0:1788652309.543264:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+17:10430:x1875537603633024:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788652309.543369:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+17:10430:x1875537603633024:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 106us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652309.543377:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 79 00000100:00100000:3.0:1788652309.548006:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652309.548162:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603633152 00000100:00100000:0.0:1788652309.548172:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603633152 00000100:00100000:0.0:1788652309.548229:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 28 00000100:00100000:0.0:1788652309.548248:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:10430:x1875537603633152:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788652309.548266:0:8297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652309.548291:0:8297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000550c93c7/0x340ed74ef02a7b0f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f095b expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.548324:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7de7351/0x340ed74ef02a7b08 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0954 expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.548334:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652309.548338:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652309.548344:0:8297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000550c93c7/0x340ed74ef02a7b0f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f095b expref: 7 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.548378:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f7de7351/0x340ed74ef02a7b08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0954 expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.548394:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f7de7351/0x340ed74ef02a7b08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0954 expref: 7 pid: 6679 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652309.548407:0:8297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe43648700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8297:1875537627773824:192.168.203.50@tcp:104: 00000100:00100000:0.0:1788652309.548512:0:8297:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b286000 going to sleep for 11 seconds 00000100:00100000:1.0:1788652309.551365:0:8297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe43648700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8297:1875537627773824:192.168.203.50@tcp:104: 00010000:00010000:1.0:1788652309.551472:0:8297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000550c93c7/0x340ed74ef02a7b0f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f095b expref: 7 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.551502:0:8297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe4151a400, rc 0) 00000100:00100000:1.0:1788652309.551610:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:10430:x1875537603633152:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 3372us (3611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652309.551619:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 28 00000100:00100000:1.0:1788652309.554602:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652309.554694:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603633280 00000100:00100000:3.0:1788652309.554703:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603633280 00010000:00010000:3.0:1788652309.554929:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f7de7351/0x340ed74ef02a7b08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0954 expref: 7 pid: 6679 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652309.555006:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 42 00000100:00100000:3.0:1788652309.555017:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51232850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2346:x1875537603633280:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652309.555032:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652309.555064:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f7de7351/0x340ed74ef02a7b08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0954 expref: 7 pid: 6679 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.555080:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f7de7351/0x340ed74ef02a7b08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0954 expref: 7 pid: 6679 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.555107:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7de7351/0x340ed74ef02a7b08 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0954 expref: 7 pid: 6679 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.555124:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652309.555129:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652309.555138:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000550c93c7/0x340ed74ef02a7b0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f095b expref: 6 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.555149:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000550c93c7/0x340ed74ef02a7b0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f095b expref: 6 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.555186:0:5821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000550c93c7/0x340ed74ef02a7b0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f095b expref: 6 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652309.555206:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe513b5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5821:1875537627773952:192.168.203.50@tcp:105: 00000100:00100000:3.0:1788652309.555441:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5eb13d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788652309.560803:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652309.560903:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603633408 00000100:00100000:0.0:1788652309.560912:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603633408 00002000:00100000:0.0:1788652309.560957:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8cbe7a0c2d80 x1875537603633408/t0(0) o4->20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp:695/0 lens 504/0 e 0 to 0 dl 1788652320 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788652309.560978:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe7a0c2d80 with x1875537603633408 ext(0->8) 00002000:00010000:0.0:1788652309.560985:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbe7a0c2d80 00000100:00100000:0.0:1788652309.561016:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:0.0:1788652309.561033:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2346:x1875537603633408:12345-192.168.203.50@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788652309.561426:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe513b5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5821:1875537627773952:192.168.203.50@tcp:105: 00010000:00010000:3.0:1788652309.561447:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652309.561673:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51232850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:2346:x1875537603633280:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 6657us (7080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652309.561683:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 42 00000100:00100000:0.0:1788652309.561714:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2346:x1875537603633408:12345-192.168.203.50@tcp:4:lhsmtool_posix.0 Request processed in 683us (951us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788652309.561721:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 0 00002000:00100000:0.0:1788652309.561729:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8cbe7a0c2d80 x1875537603633408/t4294967302(0) o4->20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp:695/0 lens 504/448 e 0 to 0 dl 1788652320 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788652309.561738:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe7a0c2d80 with x1875537603633408 ext(0->8) 00002000:00010000:0.0:1788652309.561742:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbe7a0c2d80 00000100:00100000:0.0:1788652309.566536:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652309.566629:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603633536 00000100:00100000:3.0:1788652309.566638:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603633536 00000100:00100000:3.0:1788652309.566691:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 80 00000100:00100000:3.0:1788652309.566700:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe43648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+17:10430:x1875537603633536:12345-192.168.203.50@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788652309.626564:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000001:00080000:0.0:1788652309.629628:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1788652309.629650:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788652309.629666:0:5857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:3.0:1788652309.629904:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627774080:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788652309.629977:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652309.630054:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627774080 00000100:00100000:0.0:1788652309.630062:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627774080 00000100:00100000:0.0:1788652309.630123:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788652309.630132:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627774080:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788652309.630300:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788652309.630303:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788652308 00002000:00010000:0.0:1788652309.630305:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788652309.630308:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788652308 -> 1788652308 00002000:00010000:0.0:1788652309.630310:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788652309.630353:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1875537627774080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 222us (375us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788652309.630360:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788652309.630489:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788652309.630522:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cbe7f2c2680/2, rc 0, transno 4294967303 00000100:00100000:3.0:1788652309.630529:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627774080:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1788652309.630595:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1788652309.630605:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788652309.632162:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe43648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+13:10430:x1875537603633536:12345-192.168.203.50@tcp:44:lhsmtool_posix.0 Request processed in 65454us (65624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652309.632253:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 80 00000100:00100000:1.0:1788652309.634142:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652309.634687:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603633664 00000100:00100000:3.0:1788652309.634697:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603633664 00000100:00100000:3.0:1788652309.634839:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 30 00000100:00100000:3.0:1788652309.634853:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51382680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2346:x1875537603633664:12345-192.168.203.50@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788652309.664598:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51382680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2346:x1875537603633664:12345-192.168.203.50@tcp:16:lhsmtool_posix.0 Request processed in 29739us (30454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652309.664613:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 30 00000001:00080000:2.0:1788652309.664649:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1788652309.664658:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1788652309.669233:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652309.669429:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603633920 00000100:00100000:0.0:1788652309.669449:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603633920 00000100:00100000:0.0:1788652309.669517:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 81 00000100:00100000:0.0:1788652309.669527:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+13:10430:x1875537603633920:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788652309.669588:0:6701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652309.669614:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7b01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f094d expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.669629:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cbe48888900) 00010000:00010000:0.0:1788652309.669634:0:6701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788652309.669664:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7b16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.669678:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7b16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.669688:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7b16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788652309.670664:0:6701:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2487ed5 reply state 0000000071537950 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7b16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652309.670676:0:6701:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788652309.670798:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+14:10430:x1875537603633920:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 1269us (1572us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788652309.670806:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 81 00000100:00100000:3.0:1788652309.675950:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652309.675983:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603634048 00000100:00100000:3.0:1788652309.675992:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603634048 00000100:00100000:3.0:1788652309.676055:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 31 00000100:00100000:3.0:1788652309.676066:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2347:x1875537603634048:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 00010000:00010000:1.0:1788652309.676340:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7b16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.676353:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7b16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.676367:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7b16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.676373:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151a800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652309.676378:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7b16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.676386:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7b16 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.676402:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cbe48888900) 00010000:00010000:1.0:1788652309.676405:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652309.676410:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7b16 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.676416:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7b16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788652309.678440:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788652309.678447:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788652308 -> 1788652307 00002000:00010000:3.0:1788652309.678450:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788652305 00002000:00010000:3.0:1788652309.678453:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788652308 -> 1788652307 00002000:00010000:3.0:1788652309.678455:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788652309.681552:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2347:x1875537603634048:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 Request processed in 5475us (5598us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788652309.681567:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 31 00000100:00100000:3.0:1788652309.687870:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652309.687966:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603634304 00000100:00100000:0.0:1788652309.687975:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603634304 00000100:00100000:0.0:1788652309.688022:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 82 00000100:00100000:0.0:1788652309.688032:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+13:10430:x1875537603634304:12345-192.168.203.50@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788652309.688116:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7b1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.688133:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7ade lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f093f expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.688143:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7b1d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.688175:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f093f expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.688189:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7ade lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f093f expref: 13 pid: 5835 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652309.688203:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe43648700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875537627774208:192.168.203.50@tcp:104: 00000100:00100000:0.0:1788652309.688285:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe81d12900 going to sleep for 11 seconds 00000100:00100000:1.0:1788652309.694718:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652309.694977:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe43648700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875537627774208:192.168.203.50@tcp:104: 00010000:00010000:2.0:1788652309.695005:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7b1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652309.695333:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603634432 00000100:00100000:3.0:1788652309.695341:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603634432 00010000:00010000:3.0:1788652309.695377:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7ade lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f093f expref: 14 pid: 5835 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652309.695449:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 43 00000100:00100000:3.0:1788652309.695458:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a21aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+14:2347:x1875537603634432:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652309.695490:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652309.695497:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7ade lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f093f expref: 14 pid: 5835 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.695510:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f093f expref: 14 pid: 5835 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.695531:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7ade lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f093f expref: 14 pid: 5835 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.695562:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cbe48888900) 00010000:00010000:3.0:1788652309.695567:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7b1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.695576:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7b1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.695584:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7b1d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.695617:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652309.695667:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a21aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+13:2347:x1875537603634432:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 210us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652309.695674:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 43 00010000:00010000:1.0:1788652309.695719:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7b1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.695740:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7b1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.695787:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7b1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.695795:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7b1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.695812:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7b1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.695818:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151b600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652309.695823:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7b1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.695831:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7b1d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.695840:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cbe48888900) 00010000:00010000:1.0:1788652309.695843:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788652309.695846:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7b1d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.695852:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7b1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652309.695892:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+12:10430:x1875537603634304:12345-192.168.203.50@tcp:55:lhsmtool_posix.0 Request processed in 7860us (8031us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788652309.695901:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 82 00000100:00100000:3.0:1788652309.699185:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652309.699251:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603634560 00000100:00100000:1.0:1788652309.699261:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603634560 00000100:00100000:1.0:1788652309.699313:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 32 00000100:00100000:1.0:1788652309.699323:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2346:x1875537603634560:12345-192.168.203.50@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788652309.699365:0:8297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000294c0c8a/0x340ed74ef02a7b24 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.699385:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000550c93c7/0x340ed74ef02a7b0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f095b expref: 7 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.699404:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652309.699409:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788652309.699414:0:8297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000294c0c8a/0x340ed74ef02a7b24 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.699467:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000550c93c7/0x340ed74ef02a7b0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f095b expref: 7 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.699491:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000550c93c7/0x340ed74ef02a7b0f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f095b expref: 7 pid: 8297 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652309.699507:0:8297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75987b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8297:1875537627774336:192.168.203.50@tcp:104: 00000100:00100000:1.0:1788652309.700088:0:8297:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4502c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652309.702725:0:8297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75987b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8297:1875537627774336:192.168.203.50@tcp:104: 00010000:00010000:0.0:1788652309.703247:0:8297:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000294c0c8a/0x340ed74ef02a7b24 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652309.708540:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652309.709345:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603634688 00000100:00100000:3.0:1788652309.709356:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603634688 00010000:00010000:3.0:1788652309.709400:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000550c93c7/0x340ed74ef02a7b0f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f095b expref: 8 pid: 8297 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652309.709567:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 44 00000100:00100000:3.0:1788652309.709579:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe43648700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2347:x1875537603634688:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652309.709594:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652309.709617:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000550c93c7/0x340ed74ef02a7b0f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f095b expref: 8 pid: 8297 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.709633:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000550c93c7/0x340ed74ef02a7b0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f095b expref: 8 pid: 8297 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.709662:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000550c93c7/0x340ed74ef02a7b0f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f095b expref: 8 pid: 8297 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.709676:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788652309.709681:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788652309.709686:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000294c0c8a/0x340ed74ef02a7b24 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.709696:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000294c0c8a/0x340ed74ef02a7b24 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.709726:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788652309.710375:0:8297:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000294c0c8a/0x340ed74ef02a7b24 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.710386:0:8297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000294c0c8a/0x340ed74ef02a7b24 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.710424:0:8297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000294c0c8a/0x340ed74ef02a7b24 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.710432:0:8297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000294c0c8a/0x340ed74ef02a7b24 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.710440:0:8297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000294c0c8a/0x340ed74ef02a7b24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.710447:0:8297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c8600 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:0.0:1788652309.710452:0:8297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000294c0c8a/0x340ed74ef02a7b24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.710460:0:8297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000294c0c8a/0x340ed74ef02a7b24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652309.711152:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe43648700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2347:x1875537603634688:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 1568us (2613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652309.711162:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 44 00010000:00010000:0.0:1788652309.711279:0:8297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000294c0c8a/0x340ed74ef02a7b24 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.711289:0:8297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000294c0c8a/0x340ed74ef02a7b24 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652309.711360:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2346:x1875537603634560:12345-192.168.203.50@tcp:1:lhsmtool_posix.0 Request processed in 12038us (12183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652309.711368:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 32 00000100:00100000:3.0:1788652309.724012:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652309.724103:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603634944 00000100:00100000:0.0:1788652309.724112:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603634944 00000100:00100000:0.0:1788652309.724165:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 83 00000100:00100000:0.0:1788652309.724174:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+12:10430:x1875537603634944:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788652309.724367:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7b2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.724386:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7b2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.724397:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7b2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.724652:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7b32 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.724664:0:11683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7aec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0946 expref: 13 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.724671:0:11683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7b32 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.724702:0:11683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7aec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0946 expref: 13 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.724715:0:11683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7aec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0946 expref: 13 pid: 6701 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652309.724727:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11683:1875537627774464:192.168.203.50@tcp:104: 00000100:00100000:0.0:1788652309.724871:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe81d12180 going to sleep for 11 seconds 00000100:00100000:0.0:1788652309.727879:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11683:1875537627774464:192.168.203.50@tcp:104: 00010000:00010000:0.0:1788652309.727911:0:11683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7b32 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652309.728576:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652309.729320:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603635072 00000100:00100000:3.0:1788652309.729331:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603635072 00010000:00010000:3.0:1788652309.729372:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7aec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0946 expref: 14 pid: 6701 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652309.729409:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 45 00000100:00100000:3.0:1788652309.729418:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+14:2347:x1875537603635072:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652309.729435:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652309.729441:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7aec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0946 expref: 14 pid: 6701 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.729468:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7aec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0946 expref: 14 pid: 6701 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.729500:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7aec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0946 expref: 14 pid: 6701 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.729518:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cbe48888900) 00010000:00010000:3.0:1788652309.729524:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7b32 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.729534:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7b32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.729542:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7b32 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.729578:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652309.729630:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+13:2347:x1875537603635072:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 213us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652309.729638:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 45 00010000:00010000:1.0:1788652309.729907:0:11683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7b32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.729917:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7b32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788652309.730112:0:11683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1788652309.730261:0:11683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1788652309.730305:0:11683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1788652309.730409:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75987b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11683:1875537627774592:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788652309.730470:0:11683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652309.730511:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4502c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788652309.730639:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627774592 00000100:00100000:3.0:1788652309.730645:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627774592 00000100:00100000:3.0:1788652309.730688:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788652309.730696:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f16ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11683:x1875537627774592:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788652309.730788:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f16ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11683:x1875537627774592:12345-0@lo:1000:mdt00_004.0 Request processed in 73us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652309.730796:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788652309.730839:0:11683:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788652309.730845:0:11683:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cbe7f2c2680, transno 4294967303 00000100:00100000:3.0:1788652309.730859:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75987b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11683:1875537627774592:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1788652309.731301:0:11683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1788652309.731359:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe513b7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11683:1875537627774720:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788652309.731394:0:11683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652309.731413:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7f2cbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652309.731604:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627774720 00000100:00100000:3.0:1788652309.731610:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627774720 00000100:00100000:3.0:1788652309.731633:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788652309.731639:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11683:x1875537627774720:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788652309.731811:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11683:x1875537627774720:12345-0@lo:1000:mdt00_004.0 Request processed in 171us (416us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788652309.731819:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788652309.731851:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe513b7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11683:1875537627774720:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1788652309.731879:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7b32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.731888:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7b32 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.731894:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7b32 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.731899:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151a400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652309.731903:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7b32 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.731910:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7b32 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.731930:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cbe48888900) 00010000:00010000:3.0:1788652309.731932:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788652309.731936:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7b32 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.731942:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7b32 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.731973:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a7a60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.731979:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a7a60 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.731984:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a7a60 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.731990:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c8a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652309.731992:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a7a60 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.731998:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a7a60 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.732005:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48da0000) 00010000:00010000:3.0:1788652309.732008:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788652309.732011:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a7a60 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.732017:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a7a60 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.732048:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a7b39 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.732061:0:11683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7a7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f092a expref: 16 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.732069:0:11683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a7b39 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.732091:0:11683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7a7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f092a expref: 16 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.732103:0:11683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7a7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f092a expref: 16 pid: 11683 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652309.732114:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe513b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11683:1875537627774848:192.168.203.50@tcp:104: 00000100:00100000:3.0:1788652309.732172:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe473a9480 going to sleep for 11 seconds 00000100:00100000:3.0:1788652309.740889:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652309.740973:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603635200 00000100:00100000:2.0:1788652309.740982:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603635200 00010000:00010000:2.0:1788652309.741022:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7a7c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f092a expref: 17 pid: 11683 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652309.741066:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 46 00000100:00100000:2.0:1788652309.741075:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+17:2346:x1875537603635200:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652309.741089:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652309.741096:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7a7c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f092a expref: 17 pid: 11683 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.741110:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7a7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f092a expref: 17 pid: 11683 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.741132:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48da0000) 00010000:00010000:2.0:1788652309.741138:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a7b39 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.741156:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a7b39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.741164:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a7b39 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.741183:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652309.741231:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+17:2346:x1875537603635200:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 157us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652309.741251:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 46 00010000:00010000:1.0:1788652309.743752:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7a7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f092a expref: 16 pid: 11683 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652309.743802:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe513b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11683:1875537627774848:192.168.203.50@tcp:104: 00010000:00010000:1.0:1788652309.743828:0:11683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a7b39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.743838:0:11683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a7b39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.743844:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a7b39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.743858:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a7b39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.743865:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a7b39 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.743873:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a7b39 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.743878:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652309.743883:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a7b39 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.743891:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a7b39 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.743906:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48da0000) 00010000:00010000:1.0:1788652309.743909:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652309.743914:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a7b39 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.743926:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a7b39 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.743937:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7b2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.743943:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7b2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.743949:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7b2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.743954:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151a600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652309.743957:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7b2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.743963:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7b2b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.743971:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48da0000) 00010000:00010000:1.0:1788652309.743974:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788652309.743976:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7b2b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652309.743981:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7b2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788652309.744494:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788652309.744500:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788652309.744527:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788652309.744534:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788652309.744609:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+15:10430:x1875537603634944:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 20060us (20229us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1788652309.744619:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 83 00000020:00080000:1.0:1788652309.744632:0:11683:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788652309.747077:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652309.747155:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603635456 00000100:00100000:2.0:1788652309.747164:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603635456 00000100:00100000:2.0:1788652309.747218:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00100000:2.0:1788652309.747229:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+15:10430:x1875537603635456:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788652309.747898:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788652309.748003:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1788652309.748049:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7b40 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.748063:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7b40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.748075:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7b40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.748095:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7b40 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.748101:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7b40 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.748107:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7b40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652309.748124:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788652309.748210:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+17:10430:x1875537603635456:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 980us (1141us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788652309.748218:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 20 00000020:00080000:2.0:1788652309.748222:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788652309.748533:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652309.748541:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7b40 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.748548:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e200 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:3.0:1788652309.748553:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7b40 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.748561:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7b40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.748582:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cbe485ac800) 00010000:00010000:3.0:1788652309.748585:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788652309.748589:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7b40 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.748596:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7b40 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652309.748613:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652309.748615:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652309.748616:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652309.770410:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788652309.815961:0:11982:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788652309.815969:0:11982:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788652309.816023:0:11982:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788652309.816029:0:11982:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788652309.992715:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652309.992765:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603635712 00000100:00100000:0.0:1788652309.992794:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603635712 00000100:00100000:0.0:1788652309.992860:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 84 00000100:00100000:0.0:1788652309.992881:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+17:10441:x1875537603635712:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1788652309.992906:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652309.992927:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7b47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0962 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.993023:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7b4e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.993039:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7b4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.993050:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7b4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652309.993060:0:6701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788652309.993172:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7b47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0962 expref: 20 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.993201:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7b4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0962 expref: 19 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652309.993221:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:0.0:1788652309.993224:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788652309.993228:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe4151ac00, rc 0) 00000100:00100000:0.0:1788652309.993275:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+19:10441:x1875537603635712:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 408us (569us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1788652309.993282:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 84 00000100:00100000:3.0:1788652310.004415:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652310.004948:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603635840 00000100:00100000:1.0:1788652310.004958:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603635840 00000100:00100000:1.0:1788652310.005023:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 85 00000100:00100000:1.0:1788652310.005033:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+19:10441:x1875537603635840:12345-192.168.203.50@tcp:34:lfs.0 00010000:00010000:1.0:1788652310.006478:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7b5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006507:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7b5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006519:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7b5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006534:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7b63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006540:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7b63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006545:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7b63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006765:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a7b6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006789:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a7b6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006797:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a7b6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788652310.006833:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a7b6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006853:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7b5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006860:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7b5c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006867:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7b5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006873:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652310.006878:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7b5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006885:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7b5c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006896:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:1.0:1788652310.006899:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652310.006903:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7b5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006910:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7b5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006921:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7b63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006928:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7b63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006932:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7b63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006943:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c8000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652310.006946:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7b63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006952:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7b63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006959:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cbe48da0000) 00010000:00010000:1.0:1788652310.006962:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652310.006964:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7b63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006969:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7b63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006983:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a7b6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006989:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a7b6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006994:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a7b6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.006999:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652310.007001:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a7b6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.007007:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a7b6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.007025:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48da0c00) 00010000:00010000:1.0:1788652310.007027:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652310.007030:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a7b6a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788652310.007166:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788652310.008548:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a7b6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652310.008661:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+19:10441:x1875537603635840:12345-192.168.203.50@tcp:34:lfs.0 Request processed in 3625us (4248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652310.011040:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 85 00000100:00100000:3.0:1788652310.093947:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652310.095918:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603636096 00000100:00100000:1.0:1788652310.095933:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603636096 00000100:00100000:1.0:1788652310.096011:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 86 00000100:00100000:1.0:1788652310.096034:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+19:10444:x1875537603636096:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1788652310.096055:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652310.096077:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a7b71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0969 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.096156:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7b78 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.096173:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7b78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.096186:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7b78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.096201:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7b7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.096222:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.096230:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.096477:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7b86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.096501:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7b86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.096509:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7b86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652310.096518:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788652310.096609:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7b78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.096617:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7b78 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.096623:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7b78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.096628:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c8000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652310.096632:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7b78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.096640:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7b78 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.096661:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:1.0:1788652310.096665:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652310.096670:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7b78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.096677:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7b78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.096690:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.096696:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7b7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.096702:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7b7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.096706:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652310.096709:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7b7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.096716:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7b7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.096723:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cbe48da0c00) 00010000:00010000:1.0:1788652310.096725:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652310.096728:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7b7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.096734:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7b7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.101646:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a7b71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0969 expref: 22 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.101681:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7b86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0969 expref: 21 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.101692:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48da0000) 00010000:00010000:1.0:1788652310.101695:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788652310.101699:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c9e00, rc 0) 00000100:00100000:1.0:1788652310.101799:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+21:10444:x1875537603636096:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 5767us (7861us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788652310.101809:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 86 00000100:00100000:0.0:1788652310.110139:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652310.110240:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603636224 00000100:00100000:3.0:1788652310.110249:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603636224 00000100:00100000:3.0:1788652310.110303:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 87 00000100:00100000:3.0:1788652310.110313:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+21:10444:x1875537603636224:12345-192.168.203.50@tcp:54:lfs.0 00010000:00010000:3.0:1788652310.110373:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7b94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.110388:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.110399:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.110437:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.110444:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7b94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.110451:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7b94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.110457:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652310.110461:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7b94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.110469:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7b94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.110490:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48da0000) 00010000:00010000:3.0:1788652310.110493:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788652310.110498:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7b94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.110504:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7b94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652310.110617:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+21:10444:x1875537603636224:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 305us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652310.110625:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 87 00000100:00100000:2.0:1788652310.121601:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652310.121697:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603636480 00000100:00100000:1.0:1788652310.121707:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603636480 00000100:00100000:1.0:1788652310.121766:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:1.0:1788652310.121814:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe47b49050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+21:10444:x1875537603636480:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:1.0:1788652310.122037:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe47b49050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+22:10444:x1875537603636480:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 226us (446us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788652310.122046:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:0.0:1788652310.146623:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652310.146718:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603636736 00000100:00100000:1.0:1788652310.146729:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603636736 00000100:00100000:1.0:1788652310.146864:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 88 00000100:00100000:1.0:1788652310.146885:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+22:9974:x1875537603636736:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:1.0:1788652310.146911:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652310.146933:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a7b9b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0970 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.147231:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7ba2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.147247:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7b86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0969 expref: 23 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.147256:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7ba2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.147289:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7b86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0969 expref: 23 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.147303:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7b86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0969 expref: 23 pid: 11683 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652310.147317:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f16f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875537627774976:192.168.203.50@tcp:104: 00000100:00100000:1.0:1788652310.147505:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4502ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788652310.164982:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652310.165454:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f16f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875537627774976:192.168.203.50@tcp:104: 00010000:00010000:1.0:1788652310.165490:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7ba2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652310.165625:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603636864 00000100:00100000:2.0:1788652310.165633:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603636864 00010000:00010000:2.0:1788652310.165669:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7b86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0969 expref: 24 pid: 11683 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652310.165710:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 47 00000100:00100000:2.0:1788652310.165720:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+24:2347:x1875537603636864:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652310.165734:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652310.165742:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7b86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0969 expref: 24 pid: 11683 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.165756:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7b86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0969 expref: 24 pid: 11683 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.165835:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7b86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0969 expref: 24 pid: 11683 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.165852:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48da0000) 00010000:00010000:2.0:1788652310.165856:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7ba2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.165865:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7ba2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.165885:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7ba2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.165908:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652310.165967:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+23:2347:x1875537603636864:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 248us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652310.165975:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 47 00010000:00010000:1.0:1788652310.166336:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7ba2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.166345:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7ba2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652310.166366:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788652310.166541:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a7b9b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0970 expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.166559:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7ba2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0970 expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.166567:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48da0000) 00010000:00010000:1.0:1788652310.166570:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788652310.166572:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c9800, rc 0) 00000100:00100000:1.0:1788652310.166617:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+23:9974:x1875537603636736:12345-192.168.203.50@tcp:101:bash.0 Request processed in 19744us (20005us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788652310.166625:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 88 00000100:00100000:3.0:1788652310.170421:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652310.171541:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603637120 00000100:00100000:0.0:1788652310.171553:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603637120 00000100:00100000:0.0:1788652310.171618:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 89 00000100:00100000:0.0:1788652310.171629:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+23:9974:x1875537603637120:12345-192.168.203.50@tcp:36:bash.0 00010000:00010000:0.0:1788652310.171926:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7bb0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.171944:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7bb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.171956:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7bb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788652310.172005:0:6701:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788652310.172027:0:6701:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8d43436 reply state 00000000a559dd5e transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7bb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652310.172036:0:6701:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788652310.172078:0:6701:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1788652310.172177:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+27:9974:x1875537603637120:12345-192.168.203.50@tcp:36:bash.0 Request processed in 549us (1763us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788652310.172198:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 89 00000020:00080000:0.0:1788652310.172204:0:6701:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1788652310.174009:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7bb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.174035:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7bb0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.174042:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7bb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.174048:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151a800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652310.174053:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7bb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.174061:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7bb0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.174078:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48da0000) 00010000:00010000:0.0:1788652310.174082:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652310.174087:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7bb0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.174094:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7bb0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652310.174134:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652310.174519:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603637248 00000100:00100000:2.0:1788652310.174528:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603637248 00000100:00100000:2.0:1788652310.174581:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 90 00000100:00100000:2.0:1788652310.174591:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+26:9974:x1875537603637248:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:2.0:1788652310.174613:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652310.174630:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7bb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0977 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.174688:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7bb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0977 expref: 27 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.174715:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7bb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0977 expref: 27 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.174733:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48da0000) 00010000:00010000:2.0:1788652310.174736:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788652310.174739:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215e000, rc 0) 00000100:00100000:2.0:1788652310.174827:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+27:9974:x1875537603637248:12345-192.168.203.50@tcp:101:bash.0 Request processed in 237us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652310.174834:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 90 00000100:00100000:2.0:1788652310.180761:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652310.180989:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603637376 00000100:00100000:1.0:1788652310.180998:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603637376 00000100:00100000:1.0:1788652310.181068:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 33 00000100:00100000:1.0:1788652310.181079:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:9974:x1875537603637376:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:1.0:1788652310.181097:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652310.181120:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e70f747/0x340ed74ef02a7bbe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f097e expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788652310.181145:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9cab13, atime: 0x6a9cab11, ctime: 0x6a9cab13, blocks: 0xb 00010000:00010000:1.0:1788652310.181167:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=327s v=(0 0) 00010000:00010000:1.0:1788652310.181171:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652310.181179:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e70f747/0x340ed74ef02a7bbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f097e expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.181197:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e70f747/0x340ed74ef02a7bbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f097e expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.181225:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c9a00, rc 0) 00000100:00100000:1.0:1788652310.181281:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:9974:x1875537603637376:12345-192.168.203.50@tcp:101:bash.0 Request processed in 204us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652310.181288:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 33 00000100:00100000:0.0:1788652310.185089:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652310.185290:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603637504 00000100:00100000:2.0:1788652310.185301:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603637504 00002000:00010000:2.0:1788652310.185342:0:6683:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788652310.185348:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbd422ca300 with x1875537603637504 ext(0->18446744073709551615) 00002000:00010000:2.0:1788652310.185360:0:6683:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbd422ca300. 00000100:00100000:2.0:1788652310.185384:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 1 00000100:00100000:2.0:1788652310.185393:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd422ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2346:x1875537603637504:12345-192.168.203.50@tcp:10:bash.0 00002000:00010000:2.0:1788652310.186223:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788652310.186229:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788652307 -> 1788652308 00002000:00010000:2.0:1788652310.186232:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788652305 -> 1788652305 00002000:00010000:2.0:1788652310.186234:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788652307 -> 1788652308 00002000:00010000:2.0:1788652310.186236:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788652310.186311:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd422ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2346:x1875537603637504:12345-192.168.203.50@tcp:10:bash.0 Request processed in 916us (1229us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788652310.186320:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 1 00002000:00010000:2.0:1788652310.186331:0:6683:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788652310.186334:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbd422ca300 with x1875537603637504 ext(0->18446744073709551615) 00002000:00010000:2.0:1788652310.186339:0:6683:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbd422ca300. 00000100:00100000:0.0:1788652310.273268:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652310.273535:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603637632 00000100:00100000:1.0:1788652310.273546:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603637632 00000100:00100000:1.0:1788652310.273606:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 91 00000100:00100000:1.0:1788652310.273616:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+27:10458:x1875537603637632:12345-192.168.203.50@tcp:34:lfs.0 00010000:00010000:1.0:1788652310.273686:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7bc5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.273704:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.273715:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.273730:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9c00/0x340ed74ef02a7bcc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.273737:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9c00/0x340ed74ef02a7bcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.273743:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9c00/0x340ed74ef02a7bcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.273996:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7bd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.274029:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.274037:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788652310.274074:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.274084:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.274090:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7bc5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.274096:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.274101:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c8000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652310.274104:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.274111:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7bc5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.274121:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:1.0:1788652310.274124:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652310.274128:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7bc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.274134:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7bc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.274153:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9c00/0x340ed74ef02a7bcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.274159:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9c00/0x340ed74ef02a7bcc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.274165:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9c00/0x340ed74ef02a7bcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.274170:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652310.274173:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9c00/0x340ed74ef02a7bcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.274179:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9c00/0x340ed74ef02a7bcc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.274186:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cbe48da0400) 00010000:00010000:1.0:1788652310.274189:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652310.274192:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9c00/0x340ed74ef02a7bcc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.274197:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9c00/0x340ed74ef02a7bcc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.274211:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.274218:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7bd3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.274223:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.274234:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652310.274237:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.274243:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7bd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.274251:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48da0000) 00010000:00010000:1.0:1788652310.274254:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652310.274257:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7bd3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.274262:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7bd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652310.274332:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+27:10458:x1875537603637632:12345-192.168.203.50@tcp:34:lfs.0 Request processed in 715us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652310.274340:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 91 00000100:00100000:3.0:1788652310.328929:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652310.329024:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603637888 00000100:00100000:0.0:1788652310.329033:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603637888 00000100:00100000:0.0:1788652310.329197:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 92 00000100:00100000:0.0:1788652310.329220:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+27:10461:x1875537603637888:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1788652310.329251:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652310.329273:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7bda lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0985 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.329343:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7be1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.329358:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7be1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.329371:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7be1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.329387:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7be8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.329394:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7be8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.329401:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7be8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.329653:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7bef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.329663:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7bef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.329671:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7bef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652310.329691:0:6701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788652310.329853:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7be1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.329862:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7be1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.329868:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7be1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.329874:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151a400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652310.329878:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7be1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.329886:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7be1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.329898:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:0.0:1788652310.329901:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652310.329906:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7be1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.329912:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7be1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.329924:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7be8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.329930:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7be8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.329945:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7be8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.329950:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151a600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652310.329954:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7be8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.329960:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7be8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.329968:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cbe48888200) 00010000:00010000:0.0:1788652310.329971:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652310.329974:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7be8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.329980:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7be8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.330021:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7bda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0985 expref: 30 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.330176:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7bef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0985 expref: 29 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.330186:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48da0000) 00010000:00010000:0.0:1788652310.330188:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788652310.330192:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe4151b600, rc 0) 00000100:00100000:0.0:1788652310.330262:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+29:10461:x1875537603637888:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 1042us (1341us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1788652310.330281:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 92 00000100:00100000:2.0:1788652310.333905:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652310.333982:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603638016 00000100:00100000:3.0:1788652310.333991:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603638016 00000100:00100000:3.0:1788652310.334058:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 93 00000100:00100000:3.0:1788652310.334069:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+29:10461:x1875537603638016:12345-192.168.203.50@tcp:54:lfs.0 00010000:00010000:3.0:1788652310.334135:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7bfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.334153:0:11683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7ba2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0970 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.334162:0:11683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7bfd lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.334196:0:11683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7ba2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0970 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.334208:0:11683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7ba2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0970 expref: 29 pid: 5835 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652310.334221:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd41fa9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11683:1875537627775104:192.168.203.50@tcp:104: 00000100:00100000:3.0:1788652310.334317:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe473a9900 going to sleep for 11 seconds 00000100:00100000:1.0:1788652310.336285:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd41fa9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11683:1875537627775104:192.168.203.50@tcp:104: 00010000:00010000:1.0:1788652310.336313:0:11683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7bfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652310.337860:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652310.338093:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603638272 00000100:00100000:1.0:1788652310.338101:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603638272 00000100:00100000:1.0:1788652310.338161:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 22 00000100:00100000:1.0:1788652310.338170:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+30:5585:x1875537603638272:12345-192.168.203.50@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788652310.338493:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+31:5585:x1875537603638272:12345-192.168.203.50@tcp:35:ldlm_bl.0 Request processed in 322us (638us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788652310.338517:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 22 00000100:00100000:3.0:1788652310.341338:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652310.341458:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603638400 00000100:00100000:1.0:1788652310.341468:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603638400 00010000:00010000:1.0:1788652310.341516:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7ba2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0970 expref: 31 pid: 5835 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652310.341586:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 48 00000100:00100000:1.0:1788652310.341596:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+31:2346:x1875537603638400:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652310.341610:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652310.341618:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7ba2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0970 expref: 31 pid: 5835 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.341631:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7ba2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0970 expref: 31 pid: 5835 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.341652:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7ba2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0970 expref: 31 pid: 5835 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.341667:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48da0000) 00010000:00010000:1.0:1788652310.341672:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7bfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.341682:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7bfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.341689:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7bfd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.341741:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652310.341826:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+30:2346:x1875537603638400:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 230us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652310.341839:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 48 00010000:00010000:2.0:1788652310.342060:0:11683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7bfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.342070:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7bfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.342099:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7bfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.342107:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7bfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.342114:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7bfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.342120:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652310.342125:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7bfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.342133:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7bfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.342143:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48da0000) 00010000:00010000:2.0:1788652310.342146:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788652310.342150:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7bfd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.342167:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7bfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652310.342260:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+29:10461:x1875537603638016:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 8192us (8364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652310.342268:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 93 00000100:00100000:3.0:1788652310.344964:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652310.345516:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603638656 00000100:00100000:1.0:1788652310.345527:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603638656 00000100:00100000:1.0:1788652310.345630:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:1.0:1788652310.345641:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+29:10461:x1875537603638656:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:1.0:1788652310.345914:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+30:10461:x1875537603638656:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 274us (959us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1788652310.345922:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:0.0:1788652310.459602:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652310.459682:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603638912 00000100:00100000:3.0:1788652310.459692:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603638912 00000100:00100000:3.0:1788652310.459759:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 94 00000100:00100000:3.0:1788652310.459768:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+30:10472:x1875537603638912:12345-192.168.203.50@tcp:101:cat.0 00010000:00010000:3.0:1788652310.459826:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652310.459846:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a7c04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f098c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.459917:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7c0b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.459931:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7c0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.459942:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7c0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.459958:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7c12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.459965:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7c12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.459972:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7c12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.460234:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a7c19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.460243:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a7c19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.460250:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a7c19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652310.460259:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788652310.460358:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7c0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.460367:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7c0b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.460373:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7c0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.460380:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652310.460384:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7c0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.460392:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7c0b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.460403:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:3.0:1788652310.460406:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652310.460410:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7c0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.460416:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7c0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.460428:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7c12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.460434:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7c12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.460440:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7c12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.460444:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652310.460453:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7c12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.460459:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7c12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.460466:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cbe7fde3a00) 00010000:00010000:3.0:1788652310.460469:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652310.460471:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7c12 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.460488:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7c12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.460532:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a7c04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f098c expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.460546:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a7c19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f098c expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.460552:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48da0000) 00010000:00010000:3.0:1788652310.460555:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788652310.460558:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e4200, rc 0) 00000100:00100000:3.0:1788652310.460633:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+32:10472:x1875537603638912:12345-192.168.203.50@tcp:101:cat.0 Request processed in 865us (1039us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788652310.460641:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 94 00000100:00100000:2.0:1788652310.465963:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652310.466239:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603639168 00000100:00100000:3.0:1788652310.466249:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603639168 00000100:00100000:3.0:1788652310.466305:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 24 00000100:00100000:3.0:1788652310.466316:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+32:10472:x1875537603639168:12345-192.168.203.50@tcp:35:cat.0 00000100:00100000:3.0:1788652310.466560:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+33:10472:x1875537603639168:12345-192.168.203.50@tcp:35:cat.0 Request processed in 245us (605us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788652310.466568:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 24 00000100:00100000:0.0:1788652310.485367:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652310.485580:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603639424 00000100:00100000:2.0:1788652310.485590:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603639424 00000100:00100000:2.0:1788652310.485655:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 95 00000100:00100000:2.0:1788652310.485665:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+33:10473:x1875537603639424:12345-192.168.203.50@tcp:36:rm.0 00010000:00010000:2.0:1788652310.485960:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788652310.485988:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a7c19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f098c expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.486176:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7bef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0985 expref: 32 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.486260:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7bb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0977 expref: 31 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.486273:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe48da0000) 00010000:00010000:2.0:1788652310.486284:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788652310.486307:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7c27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.486321:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7c27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.486344:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7c27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.486360:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7c2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.486367:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7c2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.486375:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7c2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.487162:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c35 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.487176:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.487184:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788652310.488137:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1788652310.488148:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 327471374907ns, next at 328471372456ns, rc = 0 00010000:00010000:2.0:1788652310.488404:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7c3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.488418:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7c3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.488428:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7c3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.488447:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7c3c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.488453:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7c3c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.488460:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7c3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.488535:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652310.488560:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.488567:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c35 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.488574:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c35 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.488580:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215f400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652310.488584:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c35 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.488592:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c35 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.488604:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe485ac900) 00010000:00010000:2.0:1788652310.488607:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788652310.488611:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c35 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.488627:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c35 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.488648:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7c27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.488653:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7c27 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.488658:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7c27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.488663:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652310.488666:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7c27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.488672:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7c27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.488680:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:2.0:1788652310.488682:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652310.488685:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7c27 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.488691:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7c27 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788652310.488701:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6538741 reply state 00000000f8ca68b8 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7c2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652310.488710:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788652310.488846:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+32:10473:x1875537603639424:12345-192.168.203.50@tcp:36:rm.0 Request processed in 3175us (3482us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788652310.488855:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 95 00010000:00010000:3.0:1788652310.489115:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652310.489123:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7c3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.489129:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215fa00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:3.0:1788652310.489132:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7c3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.489139:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7c3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.489148:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cbe485ac900) 00010000:00010000:3.0:1788652310.489151:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788652310.489154:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7c3c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.489159:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7c3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.489174:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652310.489176:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652310.489178:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652310.490637:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7c2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.490652:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7c2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.490658:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7c2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.490663:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652310.490668:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7c2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.490674:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7c2e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.490759:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cbe485ac500) 00010000:00010000:1.0:1788652310.490863:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652310.490870:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7c2e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.490877:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7c2e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652310.571998:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652310.572166:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603639680 00000100:00100000:2.0:1788652310.572176:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603639680 00000100:00100000:2.0:1788652310.572279:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 96 00000100:00100000:2.0:1788652310.572289:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+31:10479:x1875537603639680:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:2.0:1788652310.572312:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652310.572333:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7c43 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0993 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.572442:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c4a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.572457:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.572468:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.572493:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7c51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.572501:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7c51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.572508:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7c51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788652310.573987:0:11683:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788652310.574305:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7c58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.574328:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.574339:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.574376:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.574383:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c4a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.574390:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.574395:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215f400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652310.574400:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.574407:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c4a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.574418:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:2.0:1788652310.574420:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652310.574425:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c4a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.574432:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c4a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788652310.574444:0:11683:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000373a5fc8 reply state 00000000ff145aeb transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7c51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652310.574457:0:11683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788652310.574499:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7c43 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0993 expref: 34 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.574513:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7c58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0993 expref: 33 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.574521:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ace00) 00010000:00010000:2.0:1788652310.574523:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788652310.574525:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215fc00, rc 0) 00000100:00100000:2.0:1788652310.574597:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+34:10479:x1875537603639680:12345-192.168.203.50@tcp:101:bash.0 Request processed in 2310us (2610us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788652310.574605:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 96 00010000:00010000:3.0:1788652310.583578:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7c51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.583596:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7c51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.583633:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7c51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.583640:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652310.583646:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7c51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.583673:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7c51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.583702:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cbe485acd00) 00010000:00010000:3.0:1788652310.583705:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652310.583710:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7c51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.583724:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7c51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652310.587836:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652310.588465:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603639808 00000100:00100000:1.0:1788652310.588487:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603639808 00000100:00100000:1.0:1788652310.588566:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 34 00000100:00100000:1.0:1788652310.588578:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4941b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2349:x1875537603639808:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:1.0:1788652310.588595:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652310.588615:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060bcd8ed/0x340ed74ef02a7c66 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f099a expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788652310.588653:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788652310.588672:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=327s v=(0 0) 00010000:00010000:1.0:1788652310.588677:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652310.588687:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060bcd8ed/0x340ed74ef02a7c66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f099a expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.588707:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060bcd8ed/0x340ed74ef02a7c66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f099a expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.588720:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c9800, rc 0) 00000100:00100000:1.0:1788652310.588816:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4941b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2349:x1875537603639808:12345-192.168.203.50@tcp:101:bash.0 Request processed in 240us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652310.588824:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 34 00000100:00080000:3.0:1788652310.589148:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788652310.592449:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652310.593027:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603639936 00000100:00100000:1.0:1788652310.593047:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603639936 00000100:00100000:1.0:1788652310.593109:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 35 00000100:00100000:1.0:1788652310.593119:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:10479:x1875537603639936:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:1.0:1788652310.593137:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652310.593156:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a13453c/0x340ed74ef02a7c6d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f09a1 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.593190:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000060bcd8ed/0x340ed74ef02a7c66 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f099a expref: 9 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.593200:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652310.593205:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652310.593211:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a13453c/0x340ed74ef02a7c6d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09a1 expref: 9 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.593258:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000060bcd8ed/0x340ed74ef02a7c66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f099a expref: 9 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.593274:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000060bcd8ed/0x340ed74ef02a7c66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f099a expref: 9 pid: 6678 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652310.593289:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f16f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6680:1875537627775232:192.168.203.50@tcp:104: 00000100:00100000:1.0:1788652310.593575:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4502ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788652310.600067:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f16f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6680:1875537627775232:192.168.203.50@tcp:104: 00010000:00010000:0.0:1788652310.600103:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009a13453c/0x340ed74ef02a7c6d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09a1 expref: 9 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.600125:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c8000, rc 0) 00000100:00100000:0.0:1788652310.600191:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:10479:x1875537603639936:12345-192.168.203.50@tcp:101:bash.0 Request processed in 7073us (7750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652310.600200:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 35 00000100:00100000:0.0:1788652310.600664:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652310.600811:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603640064 00000100:00100000:2.0:1788652310.600818:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603640064 00010000:00010000:2.0:1788652310.600850:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000060bcd8ed/0x340ed74ef02a7c66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f099a expref: 9 pid: 6678 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652310.600885:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00100000:2.0:1788652310.600894:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe494ac450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:2346:x1875537603640064:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652310.600907:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652310.600929:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000060bcd8ed/0x340ed74ef02a7c66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f099a expref: 9 pid: 6678 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.600941:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000060bcd8ed/0x340ed74ef02a7c66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f099a expref: 9 pid: 6678 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.600980:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060bcd8ed/0x340ed74ef02a7c66 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f099a expref: 9 pid: 6678 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.600993:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652310.600997:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652310.601013:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a13453c/0x340ed74ef02a7c6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09a1 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.601024:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a13453c/0x340ed74ef02a7c6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09a1 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.601062:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009a13453c/0x340ed74ef02a7c6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09a1 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652310.601076:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5822:1875537627775360:192.168.203.50@tcp:105: 00000100:00100000:2.0:1788652310.601146:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4953f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652310.603199:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5822:1875537627775360:192.168.203.50@tcp:105: 00010000:00010000:0.0:1788652310.603223:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652310.603280:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe494ac450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2346:x1875537603640064:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 2386us (2617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652310.603290:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00100000:1.0:1788652310.605762:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652310.606228:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603640320 00000100:00100000:3.0:1788652310.606239:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603640320 00000100:00100000:3.0:1788652310.606399:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 25 00000100:00100000:3.0:1788652310.606410:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f16d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+33:10479:x1875537603640320:12345-192.168.203.50@tcp:35:bash.0 00000100:00100000:3.0:1788652310.606767:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f16d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+34:10479:x1875537603640320:12345-192.168.203.50@tcp:35:bash.0 Request processed in 359us (1013us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788652310.606808:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 25 00010000:00010000:3.0:1788652310.792051:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652310.818610:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652310.818811:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603640448 00000100:00100000:2.0:1788652310.818821:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603640448 00000100:00100000:2.0:1788652310.818886:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 97 00000100:00100000:2.0:1788652310.818897:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+34:10495:x1875537603640448:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1788652310.818921:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652310.818944:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7c74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f09a8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.819011:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.819044:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.819057:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652310.819095:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788652310.819098:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788652310.819117:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.819144:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7c74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09a8 expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.819164:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09a8 expref: 35 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.819173:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:2.0:1788652310.819176:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788652310.819180:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215f400, rc 0) 00000100:00100000:2.0:1788652310.819242:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+35:10495:x1875537603640448:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 348us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652310.819249:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 97 00000100:00100000:2.0:1788652310.826130:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652310.826279:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603640704 00000100:00100000:1.0:1788652310.826306:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603640704 00000100:00100000:1.0:1788652310.826369:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 98 00000100:00100000:1.0:1788652310.826380:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+35:10495:x1875537603640704:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1788652310.826400:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652310.826420:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7c82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f09af expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.826532:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7c89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.826546:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7c89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.826558:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7c89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652310.826568:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788652310.826691:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7c82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09af expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.826710:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7c89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09af expref: 37 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.826719:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ace00) 00010000:00010000:1.0:1788652310.826723:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788652310.826726:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c8800, rc 0) 00000100:00100000:1.0:1788652310.826847:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+37:10495:x1875537603640704:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 469us (725us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788652310.826855:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 98 00000100:00100000:1.0:1788652310.831124:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652310.831204:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603640960 00000100:00100000:2.0:1788652310.831214:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603640960 00000100:00100000:2.0:1788652310.831293:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 99 00000100:00100000:2.0:1788652310.831304:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f16fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+37:10495:x1875537603640960:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1788652310.831348:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652310.831374:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7c97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f09b6 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.831485:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7c9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.831499:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7c9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.831511:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7c9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652310.831525:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788652310.831663:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7c97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09b6 expref: 40 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.831683:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7c9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09b6 expref: 39 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.831693:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ace00) 00010000:00010000:2.0:1788652310.831696:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788652310.831699:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215e400, rc 0) 00000100:00100000:2.0:1788652310.831769:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f16fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+39:10495:x1875537603640960:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 466us (656us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788652310.831818:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 99 00000100:00100000:0.0:1788652310.833553:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652310.833639:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603641088 00000100:00100000:1.0:1788652310.833649:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603641088 00000100:00100000:1.0:1788652310.833708:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:1.0:1788652310.833718:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a286d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+39:2348:x1875537603641088:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652310.833738:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652310.833761:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7c89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09af expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.833811:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ace00) 00010000:00010000:1.0:1788652310.833816:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652310.833858:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a286d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+38:2348:x1875537603641088:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 142us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652310.833866:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:0.0:1788652310.839251:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652310.839397:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603641216 00000100:00100000:1.0:1788652310.839407:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603641216 00000100:00100000:1.0:1788652310.839464:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 36 00000100:00100000:1.0:1788652310.839485:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe742b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2347:x1875537603641216:12345-192.168.203.50@tcp:1:lfs.0 00010000:00010000:1.0:1788652310.839528:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d6aff5e/0x340ed74ef02a7cac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.839549:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a13453c/0x340ed74ef02a7c6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09a1 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.839557:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652310.839562:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788652310.839567:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d6aff5e/0x340ed74ef02a7cac lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.839615:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a13453c/0x340ed74ef02a7c6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09a1 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.839629:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a13453c/0x340ed74ef02a7c6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09a1 expref: 8 pid: 6680 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652310.839642:0:6678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f16ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6678:1875537627775488:192.168.203.50@tcp:104: 00000100:00100000:1.0:1788652310.839806:0:6678:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4502c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652310.853395:0:6678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f16ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6678:1875537627775488:192.168.203.50@tcp:104: 00010000:00010000:1.0:1788652310.853428:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008d6aff5e/0x340ed74ef02a7cac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652310.853529:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652310.853608:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603641344 00000100:00100000:1.0:1788652310.853615:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603641344 00002000:00100000:1.0:1788652310.853663:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8cbe7a287800 x1875537603641344/t0(0) o4->20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp:696/0 lens 504/0 e 0 to 0 dl 1788652321 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788652310.853673:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe7a287800 with x1875537603641344 ext(0->8) 00010000:00010000:1.0:1788652310.853680:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009a13453c/0x340ed74ef02a7c6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09a1 expref: 9 pid: 6680 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.853694:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009a13453c/0x340ed74ef02a7c6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09a1 expref: 9 pid: 6680 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788652310.853702:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cbe7a287800 00000100:00100000:1.0:1788652310.853748:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 1 00000100:00100000:1.0:1788652310.853757:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:2346:x1875537603641344:12345-192.168.203.50@tcp:4:lfs.0 00000100:00100000:1.0:1788652310.854697:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+11:2346:x1875537603641344:12345-192.168.203.50@tcp:4:lfs.0 Request processed in 936us (1164us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788652310.854707:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 1 00002000:00100000:1.0:1788652310.854715:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8cbe7a287800 x1875537603641344/t4294967302(0) o4->20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp:696/0 lens 504/448 e 0 to 0 dl 1788652321 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788652310.854724:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe7a287800 with x1875537603641344 ext(0->8) 00010000:00010000:1.0:1788652310.854731:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009a13453c/0x340ed74ef02a7c6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09a1 expref: 11 pid: 6680 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.854746:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009a13453c/0x340ed74ef02a7c6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09a1 expref: 11 pid: 6680 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788652310.854752:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cbe7a287800 00000100:00100000:0.0:1788652310.860665:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652310.860764:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603641472 00000100:00100000:2.0:1788652310.860800:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603641472 00010000:00010000:2.0:1788652310.860842:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a13453c/0x340ed74ef02a7c6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09a1 expref: 11 pid: 6680 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652310.860902:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 50 00000100:00100000:2.0:1788652310.860912:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a285500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+11:2347:x1875537603641472:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652310.860927:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788652310.860946:0:5822:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788652310.860949:0:5822:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788652309 00002000:00010000:2.0:1788652310.860951:0:5822:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788652309 00002000:00010000:2.0:1788652310.860953:0:5822:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788652309 00010000:00010000:2.0:1788652310.860958:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a13453c/0x340ed74ef02a7c6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09a1 expref: 11 pid: 6680 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.860971:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a13453c/0x340ed74ef02a7c6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09a1 expref: 11 pid: 6680 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.860993:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a13453c/0x340ed74ef02a7c6d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09a1 expref: 11 pid: 6680 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.861010:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788652310.861015:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788652310.861021:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008d6aff5e/0x340ed74ef02a7cac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.861537:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d6aff5e/0x340ed74ef02a7cac lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.861617:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652310.861694:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a285500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+10:2347:x1875537603641472:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 781us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652310.861704:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 50 00010000:00010000:1.0:1788652310.866954:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008d6aff5e/0x340ed74ef02a7cac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.866975:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d6aff5e/0x340ed74ef02a7cac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.867105:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d6aff5e/0x340ed74ef02a7cac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.867116:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d6aff5e/0x340ed74ef02a7cac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.867143:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d6aff5e/0x340ed74ef02a7cac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.867150:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9e00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:1.0:1788652310.867155:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d6aff5e/0x340ed74ef02a7cac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.867164:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d6aff5e/0x340ed74ef02a7cac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.867185:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d6aff5e/0x340ed74ef02a7cac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.867193:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d6aff5e/0x340ed74ef02a7cac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652310.867363:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe742b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:2347:x1875537603641216:12345-192.168.203.50@tcp:1:lfs.0 Request processed in 27885us (28117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652310.867374:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 36 00000100:00100000:0.0:1788652310.878911:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652310.878997:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603641728 00000100:00100000:1.0:1788652310.879009:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603641728 00000100:00100000:1.0:1788652310.879086:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 26 00000100:00100000:1.0:1788652310.879097:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe47b48850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+38:10495:x1875537603641728:12345-192.168.203.50@tcp:35:lfs.0 00000004:00010000:1.0:1788652310.879168:0:5839:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7c9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09b6 expref: 38 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788652310.879504:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1788652310.879547:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1788652310.879960:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1788652310.880015:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7cb3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.880031:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7c58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0993 expref: 42 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.880041:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7cb3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.880079:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7c58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0993 expref: 42 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652310.880094:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7c58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0993 expref: 42 pid: 11683 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652310.880108:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f16ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5839:1875537627775616:192.168.203.50@tcp:104: 00000100:00100000:1.0:1788652310.880188:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4502ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788652310.884243:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f16ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5839:1875537627775616:192.168.203.50@tcp:104: 00010000:00010000:1.0:1788652310.884285:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7cb3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652310.886605:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652310.887011:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603641856 00000100:00100000:3.0:1788652310.887022:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603641856 00010000:00010000:3.0:1788652310.887076:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7c58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0993 expref: 43 pid: 11683 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652310.887119:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 51 00000100:00100000:3.0:1788652310.887130:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a287b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+43:2346:x1875537603641856:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652310.887144:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652310.887150:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7c58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0993 expref: 43 pid: 11683 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.887164:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7c58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0993 expref: 43 pid: 11683 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.887185:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7c58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0993 expref: 43 pid: 11683 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.887203:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ace00) 00010000:00010000:3.0:1788652310.887208:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7cb3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.887217:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7cb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.887236:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7cb3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652310.887585:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652310.887660:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a287b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+42:2346:x1875537603641856:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 531us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652310.887668:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 51 00010000:00010000:2.0:1788652310.888710:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7cb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.888722:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7cb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788652310.888961:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788652310.889419:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1788652310.889550:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1875537627775744:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788652310.889618:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652310.889703:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4953f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788652310.897126:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627775744 00000100:00100000:3.0:1788652310.897142:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627775744 00000100:00100000:3.0:1788652310.897522:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788652310.897536:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5839:x1875537627775744:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788652310.897670:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5839:x1875537627775744:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 138us (8052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652310.897678:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788652310.897811:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1875537627775744:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788652310.898609:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1788652310.898696:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a286a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1875537627775872:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788652310.898746:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652310.898801:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe81d12b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788652310.898898:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627775872 00000100:00100000:1.0:1788652310.898904:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627775872 00000100:00100000:1.0:1788652310.898937:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788652310.898945:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5839:x1875537627775872:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788652310.899140:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5839:x1875537627775872:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 195us (393us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788652310.899147:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788652310.899502:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a286a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1875537627775872:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788652310.899559:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1788652310.899600:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7cb3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.899611:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7cb3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.899620:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7cb3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.899626:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c8800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652310.899630:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7cb3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.899639:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7cb3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.899655:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ace00) 00010000:00010000:0.0:1788652310.899658:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788652310.899663:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7cb3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652310.899669:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7cb3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788652310.899900:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788652310.900007:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1788652310.900019:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 327883247050ns, next at 328883244354ns, rc = 0 00000001:00080000:0.0:1788652310.900026:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1788652310.900133:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ace00) 00010000:00010000:0.0:1788652310.900136:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788652310.900144:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7c9e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09b6 expref: 46 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652310.900441:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe47b48850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+45:10495:x1875537603641728:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 21344us (21538us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1788652310.900452:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 26 00000020:00080000:0.0:1788652310.900456:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788652310.904123:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652310.904202:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603641984 00000100:00100000:2.0:1788652310.904211:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603641984 00000100:00100000:2.0:1788652310.904285:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 100 00000100:00100000:2.0:1788652310.904296:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+45:10495:x1875537603641984:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1788652310.904321:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652310.904344:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7cba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f09bd expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.904405:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7cba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09bd expref: 46 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.904419:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7cba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09bd expref: 46 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652310.904437:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:2.0:1788652310.904453:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788652310.904457:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215e200, rc 0) 00000100:00100000:2.0:1788652310.904527:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+46:10495:x1875537603641984:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 233us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652310.904535:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 100 00000100:00100000:1.0:1788652310.911125:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652310.911260:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603642240 00000100:00100000:3.0:1788652310.911272:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603642240 00000100:00100000:3.0:1788652310.911333:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 27 00000100:00100000:3.0:1788652310.911345:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f16ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+46:10495:x1875537603642240:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:3.0:1788652310.911605:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f16ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+47:10495:x1875537603642240:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 261us (489us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1788652310.911613:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 27 00000100:00100000:0.0:1788652311.055766:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652311.055892:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603642368 00000100:00100000:3.0:1788652311.055902:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603642368 00000100:00100000:3.0:1788652311.055959:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 101 00000100:00100000:3.0:1788652311.055969:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+47:10506:x1875537603642368:12345-192.168.203.50@tcp:34:lfs.0 00010000:00010000:3.0:1788652311.056219:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a7cc1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056238:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a7cc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056253:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a7cc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056283:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7cc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056292:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056299:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056385:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7ccf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056394:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7ccf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056401:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7ccf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788652311.056440:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7ccf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056453:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a7cc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056458:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a7cc1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056465:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a7cc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056470:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652311.056486:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a7cc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056501:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a7cc1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056514:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:3.0:1788652311.056517:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652311.056521:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a7cc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056528:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a7cc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056542:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056548:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7cc8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056554:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056559:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652311.056562:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056568:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7cc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056575:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cbe7fde3a00) 00010000:00010000:3.0:1788652311.056578:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652311.056581:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7cc8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056597:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7cc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056613:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7ccf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056619:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7ccf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056625:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7ccf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056630:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652311.056633:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7ccf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056639:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7ccf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056647:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:3.0:1788652311.056650:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652311.056653:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7ccf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.056659:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7ccf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652311.056742:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+47:10506:x1875537603642368:12345-192.168.203.50@tcp:34:lfs.0 Request processed in 773us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652311.056751:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 101 00000100:00100000:1.0:1788652311.113872:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652311.118165:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603642624 00000100:00100000:2.0:1788652311.118181:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603642624 00000100:00100000:2.0:1788652311.118258:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 102 00000100:00100000:2.0:1788652311.118270:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f16d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+47:10509:x1875537603642624:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1788652311.118296:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652311.118321:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7cd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f09c4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.118399:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7cdd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.118414:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7cdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.118424:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7cdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.118441:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7ce4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.118448:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.118455:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.118609:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7ceb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.118617:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7ceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.118624:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7ceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652311.118633:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788652311.118728:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7cdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.118735:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7cdd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.118742:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7cdd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.118748:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215fa00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652311.118753:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7cdd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.118761:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7cdd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.118810:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:2.0:1788652311.118814:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652311.118819:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7cdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.118837:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7cdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.118850:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7ce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.118855:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7ce4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.118862:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7ce4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.118867:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652311.118870:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7ce4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.118876:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7ce4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.118884:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cbe485ac000) 00010000:00010000:2.0:1788652311.118887:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652311.118890:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7ce4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.118895:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7ce4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.118937:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7cd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09c4 expref: 50 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.118950:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7ceb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09c4 expref: 49 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.118965:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:2.0:1788652311.118967:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788652311.118970:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215fc00, rc 0) 00000100:00100000:2.0:1788652311.119063:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f16d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+49:10509:x1875537603642624:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 795us (5201us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788652311.119072:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 102 00000100:00100000:1.0:1788652311.125271:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652311.125357:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603642752 00000100:00100000:2.0:1788652311.125368:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603642752 00000100:00100000:2.0:1788652311.125429:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 103 00000100:00100000:2.0:1788652311.125440:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f16d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+49:10509:x1875537603642752:12345-192.168.203.50@tcp:54:lfs.0 00010000:00010000:2.0:1788652311.125518:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a7cf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.125536:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a7cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.125549:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a7cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.125579:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a7cf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.125586:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a7cf9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.125593:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a7cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.125598:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe40031e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652311.125616:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a7cf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.125624:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a7cf9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.125636:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:2.0:1788652311.125640:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788652311.125644:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a7cf9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.125650:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a7cf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652311.125728:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f16d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+49:10509:x1875537603642752:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 290us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652311.125736:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 103 00000100:00100000:1.0:1788652311.134871:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652311.135016:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603643008 00000100:00100000:3.0:1788652311.135034:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603643008 00000100:00100000:3.0:1788652311.135091:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 28 00000100:00100000:3.0:1788652311.135102:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f16dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+49:10509:x1875537603643008:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:3.0:1788652311.135354:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f16dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+50:10509:x1875537603643008:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 253us (492us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788652311.135363:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 28 00000100:00100000:1.0:1788652311.233252:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652311.233367:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603643264 00000100:00100000:2.0:1788652311.233378:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603643264 00000100:00100000:2.0:1788652311.233441:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 104 00000100:00100000:2.0:1788652311.233451:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f16ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+50:10519:x1875537603643264:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:2.0:1788652311.233483:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652311.233486:0:11683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788652311.233514:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7c7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09a8 expref: 50 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.233535:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:2.0:1788652311.233540:0:11683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788652311.233554:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a7d00 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f09cb expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.233677:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7d07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.233691:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7d07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.233702:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7d07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652311.233711:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788652311.233882:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a7d00 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09cb expref: 52 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.233897:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7d07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09cb expref: 51 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.233904:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:2.0:1788652311.233906:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788652311.233909:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe40031c00, rc 0) 00000100:00100000:2.0:1788652311.233975:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f16ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+51:10519:x1875537603643264:12345-192.168.203.50@tcp:101:bash.0 Request processed in 525us (733us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788652311.233983:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 104 00000100:00100000:1.0:1788652311.237868:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652311.238160:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603643520 00000100:00100000:0.0:1788652311.238171:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603643520 00000100:00100000:0.0:1788652311.238228:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 105 00000100:00100000:0.0:1788652311.238238:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f16e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+51:10519:x1875537603643520:12345-192.168.203.50@tcp:36:bash.0 00010000:00010000:0.0:1788652311.238298:0:6701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788652311.238325:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7d07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09cb expref: 51 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.238347:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7ceb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09c4 expref: 50 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.238379:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:0.0:1788652311.238384:0:6701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788652311.238594:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7d15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.238609:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7d15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.239274:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7d15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788652311.239350:0:6701:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1788652311.239379:0:6701:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fcb4eee7 reply state 0000000076d06b6f transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7d15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652311.239389:0:6701:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788652311.239508:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f16e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+52:10519:x1875537603643520:12345-192.168.203.50@tcp:36:bash.0 Request processed in 1268us (1646us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788652311.239516:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 105 00000020:00080000:0.0:1788652311.239521:0:6701:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788652311.241589:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7d15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.241605:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7d15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.241620:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7d15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.241627:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151a600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652311.241634:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7d15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.241641:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7d15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.241659:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:1.0:1788652311.241661:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652311.241666:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7d15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.241692:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7d15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652311.244156:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652311.244249:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603643648 00000100:00100000:3.0:1788652311.244259:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603643648 00000100:00100000:3.0:1788652311.244322:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 106 00000100:00100000:3.0:1788652311.244337:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f16c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+51:10519:x1875537603643648:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:3.0:1788652311.244360:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652311.244381:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7d1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f09d2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.244495:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7d23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.244509:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7d23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.244520:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7d23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652311.244549:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788652311.244553:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788652311.244571:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7d23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.244600:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a7d1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09d2 expref: 53 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.244639:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7d23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09d2 expref: 52 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.244648:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:3.0:1788652311.244651:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788652311.244655:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5400, rc 0) 00000100:00100000:3.0:1788652311.244719:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f16c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+52:10519:x1875537603643648:12345-192.168.203.50@tcp:101:bash.0 Request processed in 384us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652311.244726:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 106 00000100:00100000:3.0:1788652311.258599:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652311.260379:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603643904 00000100:00100000:1.0:1788652311.260394:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603643904 00000100:00100000:1.0:1788652311.260483:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 29 00000100:00100000:1.0:1788652311.260495:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+52:10519:x1875537603643904:12345-192.168.203.50@tcp:35:bash.0 00000100:00100000:1.0:1788652311.261014:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+53:10519:x1875537603643904:12345-192.168.203.50@tcp:35:bash.0 Request processed in 519us (2423us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788652311.261023:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 29 00000100:00100000:1.0:1788652311.341162:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652311.343550:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603644032 00000100:00100000:2.0:1788652311.343566:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603644032 00000100:00100000:2.0:1788652311.345373:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 107 00000100:00100000:2.0:1788652311.345394:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f16c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+53:10525:x1875537603644032:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1788652311.345420:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652311.345457:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a7d2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f09d9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.345536:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7d31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.345551:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.345563:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652311.345599:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788652311.345613:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788652311.345642:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.345668:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a7d2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09d9 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.345701:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7d31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09d9 expref: 54 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.345712:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:2.0:1788652311.345715:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788652311.345719:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe40030e00, rc 0) 00000100:00100000:2.0:1788652311.346155:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f16c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+54:10525:x1875537603644032:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 768us (5001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652311.346164:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 107 00000100:00100000:0.0:1788652311.352765:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652311.352806:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603644160 00000100:00100000:2.0:1788652311.352825:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603644160 00000100:00100000:2.0:1788652311.353349:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 108 00000100:00100000:2.0:1788652311.353363:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+54:10525:x1875537603644160:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1788652311.353383:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652311.353404:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7d38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f09e0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.353481:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7d3f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.353496:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7d3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.353509:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7d3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.353525:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7d46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.353532:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7d46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.353538:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7d46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.353638:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7d4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.353647:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7d4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.353653:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7d4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652311.353708:0:6701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788652311.353713:0:6701:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788652311.353733:0:6701:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7d4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.353746:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7d4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.353754:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7d3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.353760:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7d3f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.353766:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7d3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.353801:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe40031c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652311.353806:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7d3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.353814:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7d3f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.353827:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:2.0:1788652311.353829:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652311.353835:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7d3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.353841:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7d3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.354060:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7d46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.354066:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7d46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.354072:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7d46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.354078:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215fc00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652311.354080:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7d46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.354086:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7d46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.354095:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cbe485ac000) 00010000:00010000:2.0:1788652311.354098:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652311.354101:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7d46 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.354107:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7d46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.354139:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7d38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09e0 expref: 56 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.354152:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7d4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09e0 expref: 55 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.354170:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:2.0:1788652311.354172:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788652311.354174:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215f400, rc 0) 00000100:00100000:2.0:1788652311.354229:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+55:10525:x1875537603644160:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 870us (1473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652311.354237:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 108 00000100:00100000:0.0:1788652311.360023:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652311.360212:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603644416 00000100:00100000:2.0:1788652311.360231:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603644416 00000100:00100000:0.0:1788652311.360446:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652311.360543:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 109 00000100:00100000:2.0:1788652311.360553:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+55:10525:x1875537603644416:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1788652311.360575:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652311.360597:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7d54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f09e7 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652311.360989:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603644544 00000100:00100000:1.0:1788652311.360994:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603644544 00000100:00100000:1.0:1788652311.361044:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:1.0:1788652311.361052:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a284700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+56:2346:x1875537603644544:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652311.361072:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652311.361093:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7d4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09e0 expref: 56 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.361110:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:1.0:1788652311.361115:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652311.361165:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a284700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+55:2346:x1875537603644544:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 114us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652311.361173:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 7 00010000:00010000:2.0:1788652311.361592:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7d5b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.361617:0:11683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7d23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09d2 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.361627:0:11683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7d5b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.361663:0:11683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7d23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09d2 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.363330:0:11683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7d23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09d2 expref: 55 pid: 5837 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652311.363379:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11683:1875537627776000:192.168.203.50@tcp:104: 00000100:00100000:2.0:1788652311.363487:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4953f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652311.368151:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11683:1875537627776000:192.168.203.50@tcp:104: 00010000:00010000:2.0:1788652311.368187:0:11683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7d5b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652311.368200:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652311.368311:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603644672 00000100:00100000:3.0:1788652311.368318:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603644672 00010000:00010000:3.0:1788652311.368352:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7d23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09d2 expref: 56 pid: 5837 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652311.368394:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 52 00000100:00100000:3.0:1788652311.368403:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a284380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+56:2347:x1875537603644672:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652311.368416:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652311.368423:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7d23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09d2 expref: 56 pid: 5837 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.368434:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7d23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09d2 expref: 56 pid: 5837 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.368456:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7d23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09d2 expref: 56 pid: 5837 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.368497:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:3.0:1788652311.368502:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7d5b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.368511:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7d5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.368519:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7d5b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652311.368548:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652311.368607:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a284380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+55:2347:x1875537603644672:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 205us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652311.368614:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 52 00010000:00010000:2.0:1788652311.368706:0:11683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7d5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.368715:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7d5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652311.368735:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788652311.368918:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7d54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09e7 expref: 56 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.368936:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7d5b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09e7 expref: 55 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.368944:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:2.0:1788652311.368946:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788652311.368949:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215e400, rc 0) 00000100:00100000:2.0:1788652311.368976:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+55:10525:x1875537603644416:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 8425us (8963us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788652311.368984:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 109 00000100:00100000:1.0:1788652311.374316:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652311.374583:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603644928 00000100:00100000:0.0:1788652311.374594:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603644928 00000100:00100000:0.0:1788652311.374690:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:0.0:1788652311.374702:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f16f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+55:10525:x1875537603644928:12345-192.168.203.50@tcp:103:lfs.0 00010000:00010000:0.0:1788652311.374729:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652311.374754:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7cba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09bd expref: 55 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.374903:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:0.0:1788652311.374910:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652311.374974:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f16f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+54:10525:x1875537603644928:12345-192.168.203.50@tcp:103:lfs.0 Request processed in 273us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652311.374981:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:0.0:1788652311.387120:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652311.387213:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603645056 00000100:00100000:1.0:1788652311.387285:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603645056 00000100:00100000:1.0:1788652311.387374:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 110 00000100:00100000:1.0:1788652311.387384:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+54:10525:x1875537603645056:12345-192.168.203.50@tcp:58:lfs.0 00010000:00010000:1.0:1788652311.387496:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a7d69 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.387513:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a7d69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.387524:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a7d69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788652311.387705:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788652311.387824:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+54:10525:x1875537603645056:12345-192.168.203.50@tcp:58:lfs.0 Request processed in 440us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652311.387832:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 110 00000100:00100000:3.0:1788652311.393392:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652311.393528:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603645184 00000100:00100000:2.0:1788652311.393557:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603645184 00000100:00100000:2.0:1788652311.393616:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 111 00000100:00100000:2.0:1788652311.393627:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+54:10525:x1875537603645184:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1788652311.393648:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652311.393668:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7d70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f09ee expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.393732:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a7d69 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.393743:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7d70 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09ee expref: 55 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.393763:0:6701:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a7d69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.393802:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7d70 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09ee expref: 55 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.393816:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:2.0:1788652311.393819:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788652311.393822:0:6701:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7d70 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09ee expref: 55 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.393830:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215fc00, rc 0) 00000100:00100000:2.0:1788652311.393894:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+55:10525:x1875537603645184:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 268us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652311.393901:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 111 00000040:00080000:2.0:1788652311.816023:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788652311.816031:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788652311.816082:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788652311.816088:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788652311.816214:0:11670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c1c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1875537627776128:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788652311.816331:0:11670:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4953f240 going to sleep for 11 seconds 00010000:00010000:3.0:1788652311.817533:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652311.830303:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652311.830374:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603645312 00000100:00100000:1.0:1788652311.830385:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603645312 00000100:00100000:1.0:1788652311.830454:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 112 00000100:00100000:1.0:1788652311.830465:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+56:10526:x1875537603645312:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788652311.830507:0:11683:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788652311.830617:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+56:10526:x1875537603645312:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 153us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652311.830625:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 112 00000100:00100000:2.0:1788652311.833238:0:11670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c1c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1875537627776128:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788652311.842329:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652311.842536:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603645440 00000100:00100000:2.0:1788652311.842557:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603645440 00000100:00100000:2.0:1788652311.842671:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 113 00000100:00100000:2.0:1788652311.842682:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f16ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+55:10526:x1875537603645440:12345-192.168.203.50@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788652311.842763:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7d77 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.842821:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7d77 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.842833:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7d77 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.842898:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7d7e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.842906:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7d7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.842914:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7d7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.842936:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7d85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.842957:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.842963:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652311.843001:0:6701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788652311.843005:0:6701:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788652311.843018:0:6701:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.843028:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7d77 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.843034:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7d77 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.843103:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7d77 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.843111:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215fa00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652311.843116:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7d77 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.843124:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7d77 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.843136:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbe7fde3200) 00010000:00010000:2.0:1788652311.843139:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652311.843144:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7d77 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.843289:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7d77 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.843305:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7d7e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.843311:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7d7e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.843316:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7d7e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.843320:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652311.843323:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7d7e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.843328:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7d7e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.843335:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8cbe485ac000) 00010000:00010000:2.0:1788652311.843349:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652311.843353:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7d7e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.843358:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7d7e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.843374:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.843379:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7d85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.843391:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7d85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.843396:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652311.843399:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7d85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.843404:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7d85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.843412:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:2.0:1788652311.843415:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652311.843500:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7d85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.843507:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7d85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652311.843660:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f16ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+55:10526:x1875537603645440:12345-192.168.203.50@tcp:34:lhsmtool_posix.0 Request processed in 978us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652311.843668:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 113 00000100:00100000:3.0:1788652311.857953:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652311.858210:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603645696 00000100:00100000:1.0:1788652311.858229:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603645696 00000100:00100000:1.0:1788652311.858282:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 114 00000100:00100000:1.0:1788652311.858302:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+55:10526:x1875537603645696:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788652311.858321:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652311.858340:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a7d8c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f09f5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.858432:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a7d93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.858447:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a7d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.858458:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a7d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652311.858485:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788652311.858584:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a7d93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.858592:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a7d93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.858598:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a7d93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.858603:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c8200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652311.858608:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a7d93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.858615:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a7d93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.858627:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:1.0:1788652311.858636:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788652311.858641:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a7d93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.858649:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a7d93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.858693:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a7d8c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09f5 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.858704:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbe7fde3200) 00010000:00010000:1.0:1788652311.858706:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788652311.858710:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a7d8c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09f5 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.858719:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c8c00, rc 0) 00000100:00100000:1.0:1788652311.858849:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+56:10526:x1875537603645696:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 548us (905us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1788652311.858857:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 114 00000100:00100000:3.0:1788652311.864143:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652311.864282:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603645824 00000100:00100000:0.0:1788652311.864292:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603645824 00000100:00100000:0.0:1788652311.864353:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 115 00000100:00100000:0.0:1788652311.864363:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+56:10526:x1875537603645824:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788652311.864400:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788652311.864523:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+56:10526:x1875537603645824:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 161us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652311.864532:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 115 00000100:00100000:3.0:1788652311.870162:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652311.870288:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603646080 00000100:00100000:2.0:1788652311.870299:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603646080 00000100:00100000:2.0:1788652311.870364:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 116 00000100:00100000:2.0:1788652311.870376:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+56:10526:x1875537603646080:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788652311.870396:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652311.870400:0:6701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788652311.870426:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7d31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09d9 expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.870490:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:2.0:1788652311.870495:0:6701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788652311.870509:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7da1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f09fc expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788652311.870947:0:6701:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788652311.871135:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7da8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.871149:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.871159:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.871210:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7da1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09fc expref: 58 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.871225:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7da8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09fc expref: 57 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.871233:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cbe485ac000) 00010000:00010000:2.0:1788652311.871235:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788652311.871238:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215e200, rc 0) 00000100:00100000:2.0:1788652311.871302:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+57:10526:x1875537603646080:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 928us (1149us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788652311.871309:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 116 00000100:00100000:3.0:1788652311.883223:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652311.883663:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603646336 00000100:00100000:2.0:1788652311.883673:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603646336 00000100:00100000:0.0:1788652311.884008:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 117 00000100:00100000:0.0:1788652311.884021:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+57:10526:x1875537603646336:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788652311.884083:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652311.884111:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7da8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09fc expref: 57 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.884132:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cbe485ac000) 00010000:00010000:0.0:1788652311.884159:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788652311.884181:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7db6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.884195:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7db6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.884205:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7db6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.884221:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7dbd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x6a8100e1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.884228:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7dbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6a8100e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.884234:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7dbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6a8100e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.884294:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7db6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.884302:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7db6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.884308:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7db6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.884315:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151a600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652311.884320:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7db6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.884327:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7db6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.884345:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:0.0:1788652311.884348:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652311.884353:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7db6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.884359:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7db6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.884369:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7dbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6a8100e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.884375:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7dbd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6a8100e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.884382:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7dbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6a8100e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.884388:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151a800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652311.884391:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7dbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6a8100e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.884398:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7dbd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6a8100e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.884405:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x6a8100e1 (ffff8cbe48888200) 00010000:00010000:0.0:1788652311.884407:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652311.884410:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7dbd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6a8100e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.884415:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7dbd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6a8100e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652311.884625:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+56:10526:x1875537603646336:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 606us (1594us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788652311.884633:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 117 00000100:00100000:3.0:1788652311.901926:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652311.901996:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603646464 00000100:00100000:0.0:1788652311.902007:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603646464 00000100:00100000:0.0:1788652311.902070:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 118 00000100:00100000:0.0:1788652311.902080:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+56:10526:x1875537603646464:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788652311.902099:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652311.902122:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7dc4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0a03 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.902163:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7dcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.902178:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7dcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.902191:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7dcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.902291:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7dc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a03 expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.902310:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7dcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a03 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.902319:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cbe48888200) 00010000:00010000:0.0:1788652311.902328:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788652311.902333:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe4151a600, rc 0) 00000100:00100000:0.0:1788652311.902396:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+57:10526:x1875537603646464:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 316us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652311.902403:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 118 00000100:00100000:3.0:1788652311.923860:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652311.925073:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603646720 00000100:00100000:1.0:1788652311.925087:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603646720 00000100:00100000:1.0:1788652311.925271:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 119 00000100:00100000:1.0:1788652311.925283:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+57:10526:x1875537603646720:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788652311.925370:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a7dd2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.925387:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a7dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.925399:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a7dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788652311.925701:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1788652311.925710:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 328908938052ns, next at 329908935932ns, rc = 0 00000004:00010000:1.0:1788652311.925845:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3f77bb5 reply state 00000000070a69bd transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a7dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652311.925855:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788652311.925963:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+59:10526:x1875537603646720:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 680us (2109us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1788652311.925971:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 119 00010000:00010000:0.0:1788652311.931379:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a7dd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.931396:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a7dd2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.931403:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a7dd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.931410:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c8c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652311.931414:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a7dd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.931432:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a7dd2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.931456:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cbe48888200) 00010000:00010000:0.0:1788652311.931459:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788652311.931464:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a7dd2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652311.931479:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a7dd2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652311.931929:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652311.932106:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603646848 00000100:00100000:2.0:1788652311.932117:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603646848 00000100:00100000:2.0:1788652311.932168:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 120 00000100:00100000:2.0:1788652311.932178:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+58:10526:x1875537603646848:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788652311.932202:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652311.932222:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7dd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0a0a expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.932281:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7dd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a0a expref: 59 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.932295:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7dd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a0a expref: 59 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.932315:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cbe48888200) 00010000:00010000:2.0:1788652311.932318:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788652311.932320:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215e000, rc 0) 00000100:00100000:2.0:1788652311.932425:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+59:10526:x1875537603646848:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 247us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652311.932432:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 120 00000100:00100000:3.0:1788652311.937542:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652311.937980:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603646976 00000100:00100000:0.0:1788652311.937991:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603646976 00000100:00100000:0.0:1788652311.938060:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 37 00000100:00100000:0.0:1788652311.938086:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51336300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2347:x1875537603646976:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788652311.938408:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51336300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:2347:x1875537603646976:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 Request processed in 324us (872us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788652311.938416:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 37 00000100:00080000:3.0:1788652311.939392:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788652311.945769:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652311.946014:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603647232 00000100:00100000:0.0:1788652311.946035:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603647232 00000100:00100000:0.0:1788652311.946089:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 30 00000100:00100000:0.0:1788652311.946101:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+59:10526:x1875537603647232:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788652311.946620:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+60:10526:x1875537603647232:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 519us (857us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788652311.946640:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 30 00000100:00100000:2.0:1788652311.952005:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652311.952165:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603647488 00000100:00100000:0.0:1788652311.952176:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603647488 00000100:00100000:0.0:1788652311.952244:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 121 00000100:00100000:0.0:1788652311.952255:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+60:10526:x1875537603647488:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788652311.952368:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+60:10526:x1875537603647488:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 115us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652311.952376:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 121 00000100:00100000:2.0:1788652311.959715:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652311.959879:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603647616 00000100:00100000:1.0:1788652311.959890:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603647616 00000100:00100000:1.0:1788652311.959950:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 122 00000100:00100000:1.0:1788652311.959961:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+60:10526:x1875537603647616:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788652311.959981:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652311.960002:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a7de0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0a11 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.960092:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a7de7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.960107:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a7de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.960120:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a7de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652311.960159:0:11683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788652311.960179:0:11683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a7de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.960214:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a7de0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a11 expref: 62 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.960231:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a7de7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a11 expref: 61 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.960240:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cbe48888200) 00010000:00010000:1.0:1788652311.960242:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788652311.960246:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c8e00, rc 0) 00000100:00100000:1.0:1788652311.960316:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+61:10526:x1875537603647616:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 356us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652311.960323:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 122 00000100:00100000:3.0:1788652311.965859:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652311.965999:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603647744 00000100:00100000:2.0:1788652311.966009:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603647744 00000100:00100000:2.0:1788652311.966070:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 38 00000100:00100000:2.0:1788652311.966080:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:2346:x1875537603647744:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788652311.966108:0:8297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652311.966132:0:8297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f10f3f99/0x340ed74ef02a7dee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0a18 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788652311.966171:0:8297:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cab16, blocks: 0x1 00010000:00010000:2.0:1788652311.966194:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=328s v=(0 0) 00010000:00010000:2.0:1788652311.966199:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652311.966210:0:8297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f10f3f99/0x340ed74ef02a7dee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a18 expref: 10 pid: 8297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.966238:0:8297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f10f3f99/0x340ed74ef02a7dee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a18 expref: 10 pid: 8297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.966252:0:8297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215f400, rc 0) 00000100:00100000:2.0:1788652311.966353:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+10:2346:x1875537603647744:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 273us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652311.966360:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 38 00000100:00100000:3.0:1788652311.975627:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652311.975888:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603648000 00000100:00100000:0.0:1788652311.975899:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603648000 00000100:00100000:0.0:1788652311.976187:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 123 00000100:00100000:0.0:1788652311.976199:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+61:10526:x1875537603648000:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788652311.976340:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+61:10526:x1875537603648000:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 144us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652311.976359:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 123 00000100:00100000:0.0:1788652311.980615:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652311.980679:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603648128 00000100:00100000:3.0:1788652311.980690:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603648128 00000100:00100000:3.0:1788652311.980757:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 39 00000100:00100000:3.0:1788652311.980768:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+10:10526:x1875537603648128:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788652311.980823:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652311.980844:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a7df5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0a1f expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.981136:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f10f3f99/0x340ed74ef02a7dee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a18 expref: 11 pid: 8297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.981148:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652311.981152:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652311.981158:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a7df5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a1f expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.981195:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f10f3f99/0x340ed74ef02a7dee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a18 expref: 11 pid: 8297 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.981224:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f10f3f99/0x340ed74ef02a7dee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a18 expref: 11 pid: 8297 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652311.981239:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6679:1875537627776256:192.168.203.50@tcp:104: 00000100:00100000:2.0:1788652311.981410:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4953f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652311.985894:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652311.985977:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603648256 00000100:00100000:1.0:1788652311.985986:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603648256 00010000:00010000:1.0:1788652311.986027:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f10f3f99/0x340ed74ef02a7dee lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a18 expref: 12 pid: 8297 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652311.986065:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 53 00000100:00100000:1.0:1788652311.986074:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe494acc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+12:2346:x1875537603648256:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652311.986088:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652311.986110:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f10f3f99/0x340ed74ef02a7dee lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a18 expref: 12 pid: 8297 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.986134:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f10f3f99/0x340ed74ef02a7dee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a18 expref: 12 pid: 8297 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.986179:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652311.986184:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652311.986193:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a7df5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a1f expref: 12 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.986204:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a7df5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a1f expref: 12 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652311.986255:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a7df5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a1f expref: 12 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652311.986269:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f16c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5822:1875537627776384:192.168.203.50@tcp:105: 00000100:00100000:1.0:1788652311.986356:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4502ce40 going to sleep for 11 seconds 00010000:00010000:2.0:1788652311.986598:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f10f3f99/0x340ed74ef02a7dee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a18 expref: 12 pid: 8297 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652311.986618:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6679:1875537627776256:192.168.203.50@tcp:104: 00010000:00010000:2.0:1788652311.986646:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a7df5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a1f expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652311.986657:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5400, rc 0) 00000100:00100000:2.0:1788652311.986702:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+11:10526:x1875537603648128:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 5936us (6109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652311.986720:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 39 00000100:00100000:1.0:1788652311.993163:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f16c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5822:1875537627776384:192.168.203.50@tcp:105: 00010000:00010000:1.0:1788652311.993191:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652311.993263:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe494acc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+10:2346:x1875537603648256:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 7183us (7371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652311.993275:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 53 00000100:00100000:3.0:1788652311.994243:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652312.005575:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603648384 00000100:00100000:2.0:1788652312.005591:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603648384 00002000:00100000:2.0:1788652312.005650:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8cbe51334e00 x1875537603648384/t0(0) o4->20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp:697/0 lens 504/0 e 0 to 0 dl 1788652322 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788652312.005661:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe51334e00 with x1875537603648384 ext(0->12) 00002000:00010000:2.0:1788652312.005667:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbe51334e00 00000100:00100000:2.0:1788652312.005714:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:2.0:1788652312.005739:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51334e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+10:2346:x1875537603648384:12345-192.168.203.50@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788652312.006243:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51334e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+12:2346:x1875537603648384:12345-192.168.203.50@tcp:4:lhsmtool_posix.0 Request processed in 504us (12002us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788652312.006252:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 2 00002000:00100000:2.0:1788652312.006261:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8cbe51334e00 x1875537603648384/t4294967308(0) o4->20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp:697/0 lens 504/448 e 0 to 0 dl 1788652322 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788652312.006269:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe51334e00 with x1875537603648384 ext(0->12) 00002000:00010000:2.0:1788652312.006273:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbe51334e00 00000100:00100000:3.0:1788652312.009922:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652312.010157:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603648512 00000100:00100000:2.0:1788652312.010167:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603648512 00000100:00100000:2.0:1788652312.010292:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 124 00000100:00100000:2.0:1788652312.010312:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+61:10526:x1875537603648512:12345-192.168.203.50@tcp:44:lhsmtool_posix.0 00000100:00080000:3.0:1788652312.010461:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1788652312.061214:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1788652312.061236:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788652312.061258:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cbe81d12f00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788652312.061264:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbe4370a400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cbe81d12000 00000020:00080000:3.0:1788652312.061267:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbe819de100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cbe81ad7400 00000004:00080000:3.0:1788652312.061291:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:3.0:1788652312.061355:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788652312.061377:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cbe7f2cb780 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788652312.061389:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbe49d6d400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cbe7f2cbb40 00000020:00080000:3.0:1788652312.061392:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbe49d6d200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cbe7429b800 00000100:00100000:3.0:1788652312.061744:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe51335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627776512:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788652312.061841:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652312.061924:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627776640:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788652312.061956:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652312.062003:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627776512 00000100:00100000:3.0:1788652312.062010:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627776512 00000100:00100000:3.0:1788652312.062290:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627776640 00000100:00100000:3.0:1788652312.062295:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627776640 00000100:00100000:3.0:1788652312.062315:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788652312.062323:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f87d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1875537627776512:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788652312.062358:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1788652312.062443:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c7cf882/0x340ed74ef02a7dfc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652312.062479:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e70f747/0x340ed74ef02a7bbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f097e expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652312.062489:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788652312.062493:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788652312.062498:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c7cf882/0x340ed74ef02a7dfc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652312.062530:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e70f747/0x340ed74ef02a7bbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f097e expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652312.062544:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e70f747/0x340ed74ef02a7bbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f097e expref: 11 pid: 6680 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652312.062555:0:6678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f87ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6678:1875537627776768:192.168.203.50@tcp:104: 00000100:00100000:3.0:1788652312.062691:0:6678:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe473a9780 going to sleep for 11 seconds 00000100:00100000:3.0:1788652312.062717:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788652312.062726:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f87fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1875537627776640:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788652312.062914:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788652312.062918:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788652310 00002000:00010000:3.0:1788652312.062920:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788652312.062922:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788652310 -> 1788652310 00002000:00010000:3.0:1788652312.062925:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788652312.062970:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f87fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3305:x1875537627776640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 245us (1012us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788652312.062977:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788652312.062997:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788652312.063188:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cbe7f87f800/2, rc 0, transno 4294967309 00000100:00100000:3.0:1788652312.063196:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627776640:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788652312.063842:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+15:10526:x1875537603648512:12345-192.168.203.50@tcp:44:lhsmtool_posix.0 Request processed in 53539us (53927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652312.063852:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 124 00000020:00080000:2.0:1788652312.063875:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788652312.064057:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788652312.064817:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788652312.064834:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627776896:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788652312.064883:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652312.065028:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627776896 00000100:00100000:0.0:1788652312.065035:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627776896 00000100:00100000:0.0:1788652312.065087:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788652312.065095:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3305:x1875537627776896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788652312.065114:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1788652312.065145:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9cab15, atime: 0x6a9cab15, ctime: 0x6a9cab15, blocks: 0x1 00010000:00010000:0.0:1788652312.065152:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000550c93c7/0x340ed74ef02a7e03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.065167:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=329s v=(0 0) 00010000:00010000:0.0:1788652312.065172:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652312.065177:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000550c93c7/0x340ed74ef02a7e03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.065194:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000550c93c7/0x340ed74ef02a7e03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.065202:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000550c93c7/0x340ed74ef02a7e03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.065209:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000550c93c7/0x340ed74ef02a7e03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.065241:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788652312.065907:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3305:x1875537627776896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 810us (1021us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788652312.065916:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:3.0:1788652312.066315:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652312.066324:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000550c93c7/0x340ed74ef02a7e03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652312.066343:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151a400 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:3.0:1788652312.066348:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000550c93c7/0x340ed74ef02a7e03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652312.066359:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000550c93c7/0x340ed74ef02a7e03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652312.066378:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000550c93c7/0x340ed74ef02a7e03 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652312.066500:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000550c93c7/0x340ed74ef02a7e03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652312.066523:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652312.066526:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652312.066527:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788652312.066743:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788652312.066824:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cbe7a286d80/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788652312.066833:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627776896:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788652312.067243:0:6678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f87ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6678:1875537627776768:192.168.203.50@tcp:104: 00010000:00010000:3.0:1788652312.067263:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c7cf882/0x340ed74ef02a7dfc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652312.067997:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652312.068085:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603648640 00000100:00100000:2.0:1788652312.068092:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603648640 00000100:00100000:2.0:1788652312.068190:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 43 00000100:00100000:2.0:1788652312.068199:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+12:2347:x1875537603648640:12345-192.168.203.50@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788652312.074100:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652312.074521:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603648768 00000100:00100000:0.0:1788652312.074532:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603648768 00010000:00010000:0.0:1788652312.074948:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e70f747/0x340ed74ef02a7bbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f097e expref: 13 pid: 6680 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652312.075517:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 54 00000100:00100000:0.0:1788652312.075530:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f87d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+13:2347:x1875537603648768:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788652312.075548:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652312.075555:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e70f747/0x340ed74ef02a7bbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f097e expref: 13 pid: 6680 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.075690:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e70f747/0x340ed74ef02a7bbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f097e expref: 13 pid: 6680 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.075719:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e70f747/0x340ed74ef02a7bbe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f097e expref: 13 pid: 6680 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.075737:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788652312.075742:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788652312.075749:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c7cf882/0x340ed74ef02a7dfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.075767:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c7cf882/0x340ed74ef02a7dfc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.076067:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652312.076122:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f87d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+12:2347:x1875537603648768:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 594us (2354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652312.076130:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 54 00010000:00010000:3.0:1788652312.083274:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c7cf882/0x340ed74ef02a7dfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652312.083297:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c7cf882/0x340ed74ef02a7dfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652312.083311:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c7cf882/0x340ed74ef02a7dfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652312.083320:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c7cf882/0x340ed74ef02a7dfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652312.083344:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788652312.084215:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f87d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3304:x1875537627776512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21888us (22369us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788652312.084227:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:3.0:1788652312.084291:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cbe51335f80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788652312.084299:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe51335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627776512:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788652312.084392:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652312.084401:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c7cf882/0x340ed74ef02a7dfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.084410:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4a00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:0.0:1788652312.084415:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c7cf882/0x340ed74ef02a7dfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.084426:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c7cf882/0x340ed74ef02a7dfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.084448:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c7cf882/0x340ed74ef02a7dfc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.084456:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c7cf882/0x340ed74ef02a7dfc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.084485:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652312.084495:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652312.084496:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788652312.107190:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1788652312.107210:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:1.0:1788652312.107224:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:3.0:1788652312.107375:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2347:x1875537603648640:12345-192.168.203.50@tcp:16:lhsmtool_posix.0 Request processed in 39171us (39374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652312.107447:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 43 00000100:00100000:3.0:1788652312.111266:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652312.111455:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603649024 00000100:00100000:2.0:1788652312.111472:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603649024 00000100:00100000:2.0:1788652312.111534:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 125 00000100:00100000:2.0:1788652312.111544:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f87d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+15:10526:x1875537603649024:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788652312.111596:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652312.111622:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a7de7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a11 expref: 15 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.111643:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cbe48888200) 00010000:00010000:2.0:1788652312.111647:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788652312.111678:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7e0a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.111693:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7e0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.111700:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7e0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788652312.112326:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a8eff5a reply state 00000000bc4c0b46 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7e0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652312.112341:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788652312.112523:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f87d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+16:10526:x1875537603649024:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 979us (1267us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788652312.112531:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 125 00010000:00010000:1.0:1788652312.116988:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7e0a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.117004:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7e0a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.117294:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7e0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.117301:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215f400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652312.117307:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7e0a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.117315:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7e0a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.117333:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cbe48888200) 00010000:00010000:1.0:1788652312.117336:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652312.117404:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7e0a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.117413:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7e0a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652312.118433:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652312.118579:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603649152 00000100:00100000:2.0:1788652312.118600:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603649152 00000100:00100000:2.0:1788652312.118660:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 44 00000100:00100000:2.0:1788652312.118670:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f87dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2346:x1875537603649152:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788652312.119216:0:8297:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788652312.119220:0:8297:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788652310 -> 1788652309 00002000:00010000:2.0:1788652312.119223:0:8297:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788652309 00002000:00010000:2.0:1788652312.119225:0:8297:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788652310 -> 1788652309 00002000:00010000:2.0:1788652312.119228:0:8297:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788652312.119311:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f87dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2346:x1875537603649152:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 Request processed in 642us (885us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788652312.119320:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 44 00000100:00100000:3.0:1788652312.122559:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652312.122750:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603649408 00000100:00100000:2.0:1788652312.122759:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603649408 00000100:00100000:2.0:1788652312.122876:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 126 00000100:00100000:2.0:1788652312.122885:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f87ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+15:10526:x1875537603649408:12345-192.168.203.50@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788652312.122956:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7e11 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.122972:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7dcb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a03 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.122981:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7e11 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.123017:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7dcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a03 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.123041:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7dcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a03 expref: 15 pid: 5837 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652312.123070:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6701:1875537627777024:192.168.203.50@tcp:104: 00000100:00100000:2.0:1788652312.123151:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5eb139c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652312.125867:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6701:1875537627777024:192.168.203.50@tcp:104: 00010000:00010000:2.0:1788652312.125895:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7e11 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652312.127554:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652312.128568:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603649536 00000100:00100000:1.0:1788652312.128578:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603649536 00010000:00010000:1.0:1788652312.128693:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7dcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a03 expref: 16 pid: 5837 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652312.129013:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 55 00000100:00100000:1.0:1788652312.129035:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f87e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+16:2346:x1875537603649536:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652312.129052:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652312.129060:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7dcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a03 expref: 16 pid: 5837 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.129091:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7dcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a03 expref: 16 pid: 5837 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.129113:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7dcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a03 expref: 16 pid: 5837 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.129130:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cbe48888200) 00010000:00010000:1.0:1788652312.129135:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7e11 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.129144:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7e11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.129151:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7e11 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.129181:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652312.129336:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f87e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+15:2346:x1875537603649536:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 313us (1789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652312.129344:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 55 00010000:00010000:0.0:1788652312.129397:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7e11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.129405:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7e11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.129432:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7e11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.129439:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7e11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.129447:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7e11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.129452:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215fa00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652312.129456:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7e11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.129463:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7e11 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.129483:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cbe48888200) 00010000:00010000:0.0:1788652312.129486:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788652312.129490:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7e11 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.129495:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7e11 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652312.129536:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f87ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+14:10526:x1875537603649408:12345-192.168.203.50@tcp:55:lhsmtool_posix.0 Request processed in 6652us (6986us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788652312.129552:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 126 00000100:00100000:3.0:1788652312.131995:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652312.132119:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603649664 00000100:00100000:0.0:1788652312.132127:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603649664 00000100:00100000:0.0:1788652312.132177:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 45 00000100:00100000:0.0:1788652312.132187:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f87c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2347:x1875537603649664:12345-192.168.203.50@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788652312.132235:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000eb196199/0x340ed74ef02a7e18 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.132255:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a7df5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a1f expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.132263:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788652312.132268:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788652312.132273:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb196199/0x340ed74ef02a7e18 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.132307:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a7df5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a1f expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.132321:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a7df5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a1f expref: 7 pid: 6679 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652312.132335:0:6678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a285500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6678:1875537627777152:192.168.203.50@tcp:104: 00000100:00100000:0.0:1788652312.132409:0:6678:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe81d12d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788652312.134877:0:6678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a285500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6678:1875537627777152:192.168.203.50@tcp:104: 00010000:00010000:3.0:1788652312.134905:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eb196199/0x340ed74ef02a7e18 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652312.136608:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652312.136759:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603649792 00000100:00100000:0.0:1788652312.136810:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603649792 00010000:00010000:1.0:1788652312.136916:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a7df5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a1f expref: 8 pid: 6679 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652312.136950:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 56 00000100:00100000:1.0:1788652312.136961:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f87c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2347:x1875537603649792:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652312.136976:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652312.136996:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a7df5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a1f expref: 8 pid: 6679 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.137018:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a7df5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a1f expref: 8 pid: 6679 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.137050:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a7df5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a1f expref: 8 pid: 6679 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.137068:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788652312.137073:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788652312.137080:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb196199/0x340ed74ef02a7e18 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.137091:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb196199/0x340ed74ef02a7e18 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.137128:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652312.137190:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f87c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2347:x1875537603649792:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 230us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652312.137198:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 56 00010000:00010000:0.0:1788652312.137260:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eb196199/0x340ed74ef02a7e18 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.137270:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb196199/0x340ed74ef02a7e18 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.137295:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000eb196199/0x340ed74ef02a7e18 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.137305:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb196199/0x340ed74ef02a7e18 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.137312:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb196199/0x340ed74ef02a7e18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.137319:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151b600 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:0.0:1788652312.137323:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb196199/0x340ed74ef02a7e18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.137332:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb196199/0x340ed74ef02a7e18 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.137344:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb196199/0x340ed74ef02a7e18 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.137352:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb196199/0x340ed74ef02a7e18 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652312.137408:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f87c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2347:x1875537603649664:12345-192.168.203.50@tcp:1:lhsmtool_posix.0 Request processed in 5222us (5421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652312.137416:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 45 00000100:00100000:0.0:1788652312.142962:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652312.143113:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603650048 00000100:00100000:2.0:1788652312.143123:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603650048 00000100:00100000:2.0:1788652312.143174:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 127 00000100:00100000:2.0:1788652312.143183:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+14:10526:x1875537603650048:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788652312.143270:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7e1f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.143288:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7e1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.143300:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7e1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.143509:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7e26 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.143521:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7dd9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a0a expref: 15 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.143529:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7e26 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.143578:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7dd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a0a expref: 15 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.143591:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7dd9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a0a expref: 15 pid: 11683 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652312.143604:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875537627777280:192.168.203.50@tcp:104: 00000100:00100000:2.0:1788652312.143896:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b689180 going to sleep for 11 seconds 00000100:00100000:2.0:1788652312.148436:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875537627777280:192.168.203.50@tcp:104: 00010000:00010000:2.0:1788652312.148473:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7e26 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652312.149929:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652312.150030:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603650176 00000100:00100000:1.0:1788652312.150039:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603650176 00010000:00010000:1.0:1788652312.150078:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7dd9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a0a expref: 16 pid: 11683 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652312.150121:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00100000:1.0:1788652312.150131:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a284700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+16:2347:x1875537603650176:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652312.150162:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652312.150169:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7dd9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a0a expref: 16 pid: 11683 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.150181:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7dd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a0a expref: 16 pid: 11683 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.150200:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7dd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a0a expref: 16 pid: 11683 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.150217:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cbe48888200) 00010000:00010000:1.0:1788652312.150233:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7e26 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.150244:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7e26 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.150251:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7e26 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.150282:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652312.150335:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a284700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+15:2347:x1875537603650176:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 205us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652312.150342:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 57 00010000:00010000:0.0:1788652312.150402:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7e26 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.150410:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7e26 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788652312.150597:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1788652312.150740:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1788652312.150838:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1788652312.150914:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a284380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5836:1875537627777408:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788652312.150970:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652312.150995:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe81d12c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788652312.152065:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627777408 00000100:00100000:1.0:1788652312.152074:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627777408 00000100:00100000:1.0:1788652312.152127:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788652312.152136:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1875537627777408:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788652312.152249:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1875537627777408:12345-0@lo:1000:mdt00_001.0 Request processed in 113us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652312.152263:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788652312.152367:0:5836:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1788652312.152373:0:5836:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1788652312.152394:0:5836:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cbe7f87f800, transno 4294967309 00000100:00100000:0.0:1788652312.152413:0:5836:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cbe51335f80 x1875537627776512/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788652328 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652312.152435:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a284380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5836:1875537627777408:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788652312.152925:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1788652312.152994:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a284380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5836:1875537627777536:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788652312.153028:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652312.153057:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b09ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788652312.153670:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627777536 00000100:00100000:1.0:1788652312.153678:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627777536 00000100:00100000:1.0:1788652312.153724:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788652312.153733:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a21b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1875537627777536:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788652312.153929:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a21b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5836:x1875537627777536:12345-0@lo:1000:mdt00_001.0 Request processed in 197us (899us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788652312.153935:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788652312.154256:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a284380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5836:1875537627777536:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788652312.154293:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7e26 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.154302:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7e26 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.154310:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7e26 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.154315:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652312.154320:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7e26 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.154328:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7e26 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.154343:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cbe48888200) 00010000:00010000:0.0:1788652312.154347:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788652312.154352:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7e26 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.154359:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7e26 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.154388:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a7d69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.154394:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a7d69 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.154400:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a7d69 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.154414:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652312.154417:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a7d69 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.154424:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a7d69 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.154433:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:0.0:1788652312.154436:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788652312.154443:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7d70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09ee expref: 18 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.154455:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7d70 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09ee expref: 18 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.154476:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7d70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09ee expref: 18 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.154507:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7d70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09ee expref: 18 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652312.154520:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a218a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875537627777664:192.168.203.50@tcp:105: 00000100:00100000:0.0:1788652312.154594:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe81d12240 going to sleep for 11 seconds 00000100:00100000:0.0:1788652312.158962:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652312.159050:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a218a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875537627777664:192.168.203.50@tcp:105: 00010000:00010000:2.0:1788652312.159080:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a7d69 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.159091:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a7d69 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.159124:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7e2d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.159137:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7e2d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.159148:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7e2d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.159176:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7e2d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.159183:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7e2d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.159189:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7e2d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.159194:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652312.159198:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7e2d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.159205:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7e2d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.159225:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:2.0:1788652312.159228:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652312.159232:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7e2d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.159237:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7e2d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.159246:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7e1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.159251:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7e1f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.159257:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7e1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.159266:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215f400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652312.159269:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7e1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.159275:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7e1f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.159282:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:2.0:1788652312.159284:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788652312.159287:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7e1f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652312.159292:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7e1f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652312.159507:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+18:10526:x1875537603650048:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 16323us (16552us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788652312.159518:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 127 00000020:00080000:2.0:1788652312.159523:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788652312.159910:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788652312.159916:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788652312.160570:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788652312.160586:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788652312.161042:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603650304 00000100:00100000:1.0:1788652312.161051:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603650304 00000100:00100000:1.0:1788652312.161093:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 31 00000100:00100000:1.0:1788652312.161101:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+18:10525:x1875537603650304:12345-192.168.203.50@tcp:49:lfs.0 00000100:00100000:1.0:1788652312.161209:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+18:10525:x1875537603650304:12345-192.168.203.50@tcp:49:lfs.0 Request processed in 108us (2256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652312.161215:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 31 00000100:00100000:0.0:1788652312.167198:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652312.167289:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603650560 00000100:00100000:2.0:1788652312.167298:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603650560 00000100:00100000:2.0:1788652312.167356:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 128 00000100:00100000:2.0:1788652312.167366:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+18:10525:x1875537603650560:12345-192.168.203.50@tcp:58:lfs.0 00000040:00080000:2.0:1788652312.167811:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788652312.167949:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+18:10525:x1875537603650560:12345-192.168.203.50@tcp:58:lfs.0 Request processed in 583us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652312.167958:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 128 00000100:00100000:3.0:1788652312.172393:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652312.172502:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603650816 00000100:00100000:1.0:1788652312.172513:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603650816 00000100:00100000:1.0:1788652312.172570:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 32 00000100:00100000:1.0:1788652312.172580:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe47b49c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+18:10526:x1875537603650816:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788652312.173490:0:5838:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788652312.173750:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1788652312.173922:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a7e34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.173940:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a7e34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.173963:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a7e34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.173973:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a7e34 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.173979:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a7e34 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.173986:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a7e34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.174010:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652312.174536:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652312.174544:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a7e34 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652312.174552:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c8200 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:3.0:1788652312.174556:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a7e34 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652312.174575:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a7e34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652312.174589:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cbe48da0700) 00010000:00010000:3.0:1788652312.174592:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788652312.174597:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a7e34 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652312.174603:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a7e34 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652312.174631:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652312.174633:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652312.174634:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652312.174673:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe47b49c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+20:10526:x1875537603650816:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 2090us (2285us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788652312.174683:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 32 00000020:00080000:1.0:1788652312.174688:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788652312.201393:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627777792:0@lo:400:kworker.0 00000100:00100000:2.0:1788652312.201489:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652312.201534:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788652312.201541:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627777920:0@lo:400:kworker.0 00000100:00100000:2.0:1788652312.201566:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652312.201596:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627778048:0@lo:400:kworker.0 00000100:00100000:2.0:1788652312.201618:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652312.201639:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788652312.201644:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627778176:0@lo:400:kworker.0 00000100:00100000:2.0:1788652312.201878:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627777792 00000100:00100000:2.0:1788652312.201891:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627777792 00000100:00100000:2.0:1788652312.201938:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788652312.201960:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:3303:x1875537627777792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652312.202037:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:3303:x1875537627777792:12345-0@lo:400:kworker.0 Request processed in 79us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652312.202044:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788652312.202077:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627777920 00000100:00100000:2.0:1788652312.202081:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627777920 00000100:00100000:2.0:1788652312.202107:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627778048 00000100:00100000:2.0:1788652312.202111:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627778048 00000100:00100000:2.0:1788652312.202145:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788652312.202152:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627777920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652312.202189:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627777920:12345-0@lo:400:kworker.0 Request processed in 38us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652312.202196:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788652312.202209:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788652312.202216:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627778048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652312.202254:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f347b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627778048:12345-0@lo:400:kworker.0 Request processed in 39us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652312.202260:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1788652312.202277:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652312.202310:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652312.202346:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627778176 00000100:00100000:2.0:1788652312.202347:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627778048:0@lo:400:kworker.0 00000100:00100000:1.0:1788652312.202353:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627778176 00000100:00100000:2.0:1788652312.202384:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627777920:0@lo:400:kworker.0 00000100:00100000:2.0:1788652312.202396:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627777792:0@lo:400:kworker.0 00000100:00100000:1.0:1788652312.202402:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788652312.202413:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627778176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652312.202461:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f346a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627778176:12345-0@lo:400:kworker.0 Request processed in 50us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652312.202479:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788652312.202490:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627778176:0@lo:400:kworker.0 00000100:00080000:1.0:1788652312.202498:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652312.209158:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652312.212857:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603650944 00000100:00100000:0.0:1788652312.212872:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603650944 00000100:00100000:0.0:1788652312.212934:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 129 00000100:00100000:0.0:1788652312.212945:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f87f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+20:10528:x1875537603650944:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1788652312.212968:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652312.212988:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7e3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0a26 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.213121:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7e42 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.213137:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7e42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.213150:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7e42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.213164:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7e49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.213172:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7e49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.213180:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7e49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.213521:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7e50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.213534:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7d5b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09e7 expref: 21 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.213550:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7e50 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.213588:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7d5b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09e7 expref: 21 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652312.213606:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7d5b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09e7 expref: 21 pid: 11683 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652312.213989:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a21aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875537627778304:192.168.203.50@tcp:104: 00000100:00100000:0.0:1788652312.214209:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe81d12900 going to sleep for 11 seconds 00000100:00100000:0.0:1788652312.217647:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652312.218595:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603651200 00000100:00100000:3.0:1788652312.218606:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603651200 00000100:00100000:3.0:1788652312.218679:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 33 00000100:00100000:3.0:1788652312.218691:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+22:5585:x1875537603651200:12345-192.168.203.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788652312.218962:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+23:5585:x1875537603651200:12345-192.168.203.50@tcp:35:ldlm_bl.0 Request processed in 273us (1325us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1788652312.218969:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 33 00000100:00100000:3.0:1788652312.221333:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652312.221367:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603651328 00000100:00100000:3.0:1788652312.221377:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603651328 00010000:00010000:3.0:1788652312.221415:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7d5b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09e7 expref: 23 pid: 11683 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652312.221483:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 58 00000100:00100000:3.0:1788652312.221493:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f87f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+23:2346:x1875537603651328:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652312.221508:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652312.221515:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7d5b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09e7 expref: 23 pid: 11683 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652312.221529:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7d5b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09e7 expref: 23 pid: 11683 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652312.221552:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:3.0:1788652312.221557:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7e50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652312.221567:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7e50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652312.221575:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7e50 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652312.221594:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652312.221638:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f87f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+23:2346:x1875537603651328:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 146us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652312.221646:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 58 00010000:00010000:1.0:1788652312.224307:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7d5b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09e7 expref: 22 pid: 11683 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652312.224333:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a21aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875537627778304:192.168.203.50@tcp:104: 00010000:00010000:1.0:1788652312.224370:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7e50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.224380:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7e50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.224385:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7e50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652312.224433:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788652312.224438:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788652312.224458:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7e50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.224481:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7e50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.224491:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7e42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.224497:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7e42 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.224504:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7e42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.224509:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151b600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652312.224512:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7e42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.224519:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7e42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.224545:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:1.0:1788652312.224549:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652312.224553:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7e42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.224560:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151b600/0x340ed74ef02a7e42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.224573:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7e49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.224579:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7e49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.224585:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7e49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.224590:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151a600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652312.224593:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7e49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.224600:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7e49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.224608:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cbe48888600) 00010000:00010000:1.0:1788652312.224610:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652312.224613:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7e49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.224618:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a600/0x340ed74ef02a7e49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.224667:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a400/0x340ed74ef02a7e3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a26 expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.225079:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7e50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a26 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652312.225087:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:1.0:1788652312.225089:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788652312.225093:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe4151a800, rc 0) 00000100:00100000:1.0:1788652312.225262:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f87f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+21:10528:x1875537603650944:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 12317us (16229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652312.225272:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 129 00000100:00100000:3.0:1788652312.244491:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652312.244522:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652312.244557:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652312.244588:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603651584 00000100:00100000:3.0:1788652312.244610:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603651584 00000100:00100000:3.0:1788652312.244668:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 72 00000100:00100000:3.0:1788652312.244678:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:2348:x1875537603651584:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1788652312.244748:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:2348:x1875537603651584:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 71us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652312.244755:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 72 00000100:00100000:0.0:1788652312.247352:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603651712 00000100:00100000:0.0:1788652312.247367:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603651712 00000100:00100000:0.0:1788652312.247447:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 129 00000100:00100000:0.0:1788652312.247457:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f87ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2348:x1875537603651712:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1788652312.247541:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f87ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2348:x1875537603651712:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 86us (3017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652312.247549:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 129 00000100:00100000:1.0:1788652312.248322:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603651456 00000100:00100000:1.0:1788652312.248329:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603651456 00000100:00100000:1.0:1788652312.248376:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 286 00000100:00100000:1.0:1788652312.248384:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2348:x1875537603651456:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652312.248425:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2348:x1875537603651456:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 42us (3944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652312.248433:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 286 00000100:00080000:3.0:1788652312.248577:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788652312.248583:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788652312.276732:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1788652312.276756:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1788652312.714907:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627778432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788652312.714975:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652312.715074:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627778432 00000100:00100000:3.0:1788652312.715081:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627778432 00000100:00100000:3.0:1788652312.715125:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788652312.715133:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f87e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627778432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788652312.715426:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652312.715488:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f87e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627778432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 354us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652312.715495:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788652312.715532:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788652312.715537:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:3.0:1788652312.715558:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cbe7f2c3b80, transno 4294967301 00000004:00080000:3.0:1788652312.715567:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1788652312.715576:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cbe7a286d80, transno 4294967304 00000100:00100000:3.0:1788652312.715586:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627778432:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788652312.841966:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788652313.166242:0:12034:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788652313.166297:0:12034:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788652313.166350:0:12034:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788652313.166358:0:12034:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788652313.226006:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788652313.226017:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788652313.226076:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788652313.226086:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788652313.226208:0:11670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f16ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1875537627778560:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788652313.228836:0:11670:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe47eee540 going to sleep for 11 seconds 00000100:00100000:2.0:1788652313.236841:0:11670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f16ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1875537627778560:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788652313.239621:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652313.239859:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603651840 00000100:00100000:2.0:1788652313.239868:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603651840 00000100:00100000:2.0:1788652313.239931:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 130 00000100:00100000:2.0:1788652313.239941:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f16dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+21:10540:x1875537603651840:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788652313.239973:0:6701:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788652313.240072:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f16dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+21:10540:x1875537603651840:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 131us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652313.240080:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 130 00000100:00100000:0.0:1788652313.248660:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652313.248816:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603652096 00000100:00100000:1.0:1788652313.248826:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603652096 00000100:00100000:1.0:1788652313.248879:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 131 00000100:00100000:1.0:1788652313.248889:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+21:10540:x1875537603652096:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788652313.248909:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652313.248929:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7e57 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0a2d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652313.249023:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7e5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652313.249039:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652313.249052:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652313.249063:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788652313.249190:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7e57 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a2d expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652313.249206:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7e5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a2d expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652313.249215:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:1.0:1788652313.249218:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788652313.249222:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c9800, rc 0) 00000100:00100000:1.0:1788652313.249288:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+23:10540:x1875537603652096:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 401us (637us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788652313.249309:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 131 00000100:00100000:1.0:1788652313.257245:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652313.258727:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652313.258874:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603652352 00000100:00100000:2.0:1788652313.258885:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603652352 00000100:00100000:2.0:1788652313.258938:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 132 00000100:00100000:2.0:1788652313.258949:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+23:10540:x1875537603652352:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788652313.259060:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7e6c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652313.259091:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7e6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652313.259105:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7e6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652313.259316:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7e6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652313.259324:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7e6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652313.259331:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7e6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652313.259337:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652313.259341:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7e6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652313.259350:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7e6c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652313.259363:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:2.0:1788652313.259366:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788652313.259371:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7e6c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652313.259377:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e000/0x340ed74ef02a7e6c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652313.260169:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+24:10540:x1875537603652352:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 1216us (2924us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788652313.260191:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 132 00000040:00080000:2.0:1788652313.260345:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788652313.260350:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788652313.261431:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788652313.261444:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788652313.262440:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603652480 00000100:00100000:3.0:1788652313.262471:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603652480 00000100:00100000:3.0:1788652313.263333:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:3.0:1788652313.263347:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f16c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+24:2349:x1875537603652480:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652313.263362:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652313.263386:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7e5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a2d expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652313.263403:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:3.0:1788652313.263409:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652313.263851:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f16c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+23:2349:x1875537603652480:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 506us (5130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652313.263860:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:1.0:1788652313.272036:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652313.272116:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603652736 00000100:00100000:3.0:1788652313.272130:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603652736 00000100:00100000:3.0:1788652313.272202:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 34 00000100:00100000:3.0:1788652313.272213:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f16df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+23:10540:x1875537603652736:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788652313.272619:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f16df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+24:10540:x1875537603652736:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 406us (594us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788652313.272628:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 34 00000100:00100000:1.0:1788652313.736626:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788652313.736650:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627778688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788652313.736720:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652313.736970:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627778688 00000100:00100000:3.0:1788652313.736978:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627778688 00000100:00100000:3.0:1788652313.737022:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788652313.737030:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f16e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875537627778688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788652313.737066:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652313.737120:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f16e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875537627778688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652313.737143:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788652313.737467:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f87df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627778688:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788652313.864759:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652314.887929:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788652315.215511:0:12085:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788652315.215521:0:12085:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788652315.215565:0:12085:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788652315.215574:0:12085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788652315.446402:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652315.446937:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603652992 00000100:00100000:3.0:1788652315.446948:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603652992 00000100:00100000:3.0:1788652315.447020:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 133 00000100:00100000:3.0:1788652315.447031:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f16f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+24:10561:x1875537603652992:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1788652315.447055:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652315.447076:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7e73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0a34 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652315.447173:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a7e7a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652315.447200:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a7e7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652315.447214:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a7e7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652315.447226:0:6701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788652315.447348:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7e73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a34 expref: 27 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788652315.447499:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788652315.447851:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a7e7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a34 expref: 26 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652315.447862:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:3.0:1788652315.447866:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788652315.447876:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e4e00, rc 0) 00000100:00100000:3.0:1788652315.447941:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f16f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+26:10561:x1875537603652992:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 911us (1549us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788652315.447948:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 133 00000100:00100000:1.0:1788652315.455683:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652315.455988:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603653120 00000100:00100000:0.0:1788652315.455998:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603653120 00000100:00100000:0.0:1788652315.456060:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 134 00000100:00100000:0.0:1788652315.456070:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f16ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+26:10561:x1875537603653120:12345-192.168.203.50@tcp:54:lfs.0 00010000:00010000:0.0:1788652315.456138:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7e88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652315.456156:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652315.456169:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652315.456207:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652315.456216:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7e88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652315.456222:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7e88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652315.456228:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e56e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652315.456232:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7e88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652315.456240:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7e88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652315.456251:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:0.0:1788652315.456254:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788652315.456258:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7e88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652315.456273:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a7e88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652315.456340:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f16ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+26:10561:x1875537603653120:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 271us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652315.456348:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 134 00000100:00100000:3.0:1788652315.572186:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652315.572326:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603653248 00000100:00100000:2.0:1788652315.572337:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603653248 00000100:00100000:2.0:1788652315.572424:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 46 00000100:00100000:2.0:1788652315.572436:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f87f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2347:x1875537603653248:12345-192.168.203.50@tcp:101:cat.0 00010000:00010000:2.0:1788652315.572465:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652315.572497:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a58c37e8/0x340ed74ef02a7e8f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0a3b expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788652315.572528:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9cab15, atime: 0x6a9cab15, ctime: 0x6a9cab15, blocks: 0xb 00010000:00010000:2.0:1788652315.572550:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=332s v=(0 0) 00010000:00010000:2.0:1788652315.572556:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652315.572567:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a58c37e8/0x340ed74ef02a7e8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a3b expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652315.572587:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a58c37e8/0x340ed74ef02a7e8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a3b expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652315.572603:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215e000, rc 0) 00000100:00100000:2.0:1788652315.572675:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f87f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2347:x1875537603653248:12345-192.168.203.50@tcp:101:cat.0 Request processed in 241us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652315.572683:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 46 00000100:00080000:1.0:1788652315.573548:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788652315.577584:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652315.577694:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603653376 00000100:00100000:0.0:1788652315.577705:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603653376 00002000:00100000:0.0:1788652315.577757:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8cbe7f16d500 x1875537603653376/t0(0) o3->20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp:701/0 lens 488/0 e 0 to 0 dl 1788652326 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788652315.577804:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe7f16d500 with x1875537603653376 ext(0->4095) 00002000:00010000:0.0:1788652315.577811:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbe7f16d500 00000100:00100000:0.0:1788652315.577844:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:0.0:1788652315.577854:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f16d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2347:x1875537603653376:12345-192.168.203.50@tcp:3:cat.0 00000100:00100000:0.0:1788652315.578115:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f16d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2347:x1875537603653376:12345-192.168.203.50@tcp:3:cat.0 Request processed in 262us (540us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788652315.578123:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 3 00002000:00100000:0.0:1788652315.578131:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8cbe7f16d500 x1875537603653376/t0(0) o3->20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp:701/0 lens 488/4536 e 0 to 0 dl 1788652326 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788652315.578139:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe7f16d500 with x1875537603653376 ext(0->4095) 00002000:00010000:0.0:1788652315.578143:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbe7f16d500 00010000:00010000:3.0:1788652315.911899:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652316.936305:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652317.328979:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627778816:0@lo:400:kworker.0 00000100:00100000:3.0:1788652317.329060:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652317.329116:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627779328:0@lo:400:kworker.0 00000100:00100000:3.0:1788652317.329152:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652317.329186:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788652317.329195:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875537627778944:0@lo:400:kworker.0 00000100:00100000:3.0:1788652317.329219:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652317.329238:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627779456:0@lo:400:kworker.0 00000100:00100000:3.0:1788652317.329263:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652317.331127:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627779328 00000100:00100000:3.0:1788652317.331142:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627779328 00000100:00100000:3.0:1788652317.331205:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627778944 00000100:00100000:3.0:1788652317.331209:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627778944 00000100:00100000:3.0:1788652317.331235:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788652317.331246:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627779328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652317.331339:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627779328:12345-0@lo:400:kworker.0 Request processed in 93us (2184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652317.331347:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788652317.331370:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788652317.331379:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f87df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875537627778944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652317.331444:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f87df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875537627778944:12345-0@lo:400:kworker.0 Request processed in 54us (2211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652317.331451:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788652317.331485:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627779456 00000100:00100000:3.0:1788652317.331489:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627779456 00000100:00100000:3.0:1788652317.333537:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788652317.333554:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627779456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652317.333632:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a286d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627779456:12345-0@lo:400:kworker.0 Request processed in 85us (4367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652317.333640:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1788652317.333671:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788652317.333677:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652317.333728:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f345880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875537627778944:0@lo:400:kworker.0 00000100:00100000:3.0:1788652317.333743:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f346300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627779456:0@lo:400:kworker.0 00000100:00100000:3.0:1788652317.333759:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f344a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627779328:0@lo:400:kworker.0 00000100:00100000:1.0:1788652317.333983:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627778816 00000100:00100000:1.0:1788652317.333990:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627778816 00000100:00100000:1.0:1788652317.334038:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788652317.334045:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:3305:x1875537627778816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652317.334089:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:3305:x1875537627778816:12345-0@lo:400:kworker.0 Request processed in 45us (5029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652317.334096:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788652317.334128:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627779072:0@lo:400:kworker.0 00000100:00100000:2.0:1788652317.334169:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652317.334198:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788652317.334205:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627779200:0@lo:400:kworker.0 00000100:00100000:2.0:1788652317.334233:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652317.335712:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f347800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627778816:0@lo:400:kworker.0 00000100:00100000:1.0:1788652317.341126:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627779072 00000100:00100000:1.0:1788652317.341141:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627779072 00000100:00100000:1.0:1788652317.341208:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788652317.341218:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627779072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652317.341308:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f344700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627779072:12345-0@lo:400:kworker.0 Request processed in 91us (7137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652317.341315:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788652317.343240:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627779072:0@lo:400:kworker.0 00000100:00100000:3.0:1788652317.343746:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627779200 00000100:00100000:3.0:1788652317.343755:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627779200 00000100:00080000:3.0:1788652317.343794:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652317.343866:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788652317.343876:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1875537627779200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652317.343949:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f344380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1875537627779200:12345-0@lo:400:kworker.0 Request processed in 75us (9716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652317.343957:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788652317.343992:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f345c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627779200:0@lo:400:kworker.0 00000100:00080000:0.0:1788652317.344407:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788652317.366267:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652317.366305:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652317.366336:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652317.366374:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652317.366407:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603654016 00000100:00100000:1.0:1788652317.366417:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603654016 00000100:00100000:1.0:1788652317.366488:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603653632 00000100:00100000:1.0:1788652317.366491:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603653632 00000100:00100000:1.0:1788652317.366524:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 133 00000100:00100000:1.0:1788652317.366534:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2348:x1875537603654016:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652317.366608:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2348:x1875537603654016:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 76us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652317.366616:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 133 00000100:00100000:1.0:1788652317.366636:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 134 00000100:00100000:1.0:1788652317.366645:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+26:2348:x1875537603653632:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652317.366670:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+26:2348:x1875537603653632:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 27us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652317.366676:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 134 00000100:00080000:1.0:1788652317.366812:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788652317.366918:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603653504 00000100:00100000:0.0:1788652317.366923:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603653504 00000100:00100000:0.0:1788652317.366959:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 288 00000100:00100000:0.0:1788652317.366966:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2348:x1875537603653504:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1788652317.366997:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2348:x1875537603653504:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 32us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652317.367003:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 288 00000100:00100000:2.0:1788652317.367862:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603653760 00000100:00100000:2.0:1788652317.367871:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603653760 00000100:00100000:2.0:1788652317.367921:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 75 00000100:00100000:2.0:1788652317.367929:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f16f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2348:x1875537603653760:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652317.367970:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f16f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2348:x1875537603653760:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 42us (1664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652317.367977:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 75 00000100:00080000:2.0:1788652317.367997:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788652317.374013:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652317.374233:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603653888 00000100:00100000:3.0:1788652317.374242:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603653888 00000100:00100000:3.0:1788652317.374355:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 76 00000100:00100000:3.0:1788652317.374366:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2348:x1875537603653888:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1788652317.374448:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2348:x1875537603653888:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 84us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652317.374456:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 76 00000100:00080000:3.0:1788652317.374478:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788652317.382892:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967406 is committed 00000020:00080000:3.0:1788652317.382906:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cbe4b09a540 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1788652317.382912:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbe471fc000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cbe4b09a3c0 00000020:00080000:3.0:1788652317.382916:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbe471fc300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cbe7a64cc00 00000001:00080000:3.0:1788652317.382944:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000001:00080000:3.0:1788652317.382961:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:3.0:1788652317.382975:0:5857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:3.0:1788652317.382981:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1788652317.387173:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788652317.387366:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:3.0:1788652317.398590:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1788652317.398607:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:1.0:1788652317.835033:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788652317.835061:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627779584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788652317.835152:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652317.835932:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627779584 00000100:00100000:3.0:1788652317.835941:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627779584 00000100:00100000:3.0:1788652317.836011:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788652317.836021:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe74acce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627779584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788652317.836063:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652317.836130:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe74acce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627779584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652317.836149:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788652317.836256:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f345180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627779584:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788652317.959939:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652318.862688:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788652318.862714:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f347480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627779712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788652318.863004:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652318.865660:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627779712 00000100:00100000:2.0:1788652318.865675:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627779712 00000100:00100000:2.0:1788652318.865749:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788652318.865760:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81f25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627779712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788652318.865825:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788652318.865912:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81f25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627779712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (2908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652318.865920:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788652318.865993:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1788652318.865999:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cbe51335f80, transno 4294967310 00000004:00080000:2.0:1788652318.866030:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1788652318.866061:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f347480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627779712:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788652318.984093:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652320.008248:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652321.032111:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788652321.480085:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788652321.480095:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788652321.480370:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1788652321.480378:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788652321.630187:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652321.630850:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603654144 00000100:00100000:0.0:1788652321.630862:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603654144 00000100:00100000:0.0:1788652321.630944:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 135 00000100:00100000:0.0:1788652321.630956:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81f25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+13:10213:x1875537603654144:12345-192.168.203.50@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788652321.631061:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81f25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+13:10213:x1875537603654144:12345-192.168.203.50@tcp:60:lhsmtool_posix.0 Request processed in 107us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652321.631070:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 135 00000100:00080000:3.0:1788652321.637259:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652321.642882:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652321.643211:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603654400 00000100:00100000:0.0:1788652321.643220:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603654400 00000100:00100000:0.0:1788652321.643270:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 35 00000100:00100000:0.0:1788652321.643279:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+13:10213:x1875537603654400:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788652321.643603:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+14:10213:x1875537603654400:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 323us (727us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788652321.643610:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 35 00000100:00100000:2.0:1788652321.983901:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652321.984053:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603654528 00000100:00100000:1.0:1788652321.984063:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603654528 00000100:00100000:1.0:1788652321.984139:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 136 00000100:00100000:1.0:1788652321.984149:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:11016:x1875537603654528:12345-192.168.203.50@tcp:101:lsof.0 00010000:00010000:1.0:1788652321.984169:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652321.984190:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a7e96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0a42 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652321.984253:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7e9d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652321.984268:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7e9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652321.984280:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7e9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652321.984317:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788652321.984321:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788652321.984360:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7e9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652321.984386:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a7e96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a42 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652321.984434:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7e9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a42 expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652321.984443:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe48da0100) 00010000:00010000:1.0:1788652321.984446:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788652321.984449:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c9400, rc 0) 00000100:00100000:1.0:1788652321.984517:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f347480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3eb94160-5684-49f0-9e45-fbf338e18f8d+6:11016:x1875537603654528:12345-192.168.203.50@tcp:101:lsof.0 Request processed in 368us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652321.984524:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 136 00000100:00080000:3.0:1788652321.984897:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788652322.055986:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652322.440940:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b04ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627780224:0@lo:400:kworker.0 00000100:00100000:1.0:1788652322.441032:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652322.441105:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788652322.441112:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b04d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875537627780096:0@lo:400:kworker.0 00000100:00100000:1.0:1788652322.441138:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652322.441180:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627780096 00000100:00100000:1.0:1788652322.441189:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627780096 00000100:00100000:1.0:1788652322.441258:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788652322.441269:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875537627780096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652322.441332:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875537627780096:12345-0@lo:400:kworker.0 Request processed in 66us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652322.441340:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788652322.441409:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b04d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875537627780096:0@lo:400:kworker.0 00000100:00100000:2.0:1788652322.441502:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875537627779968:0@lo:400:kworker.0 00000100:00100000:2.0:1788652322.441587:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652322.441630:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b04ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627780480:0@lo:400:kworker.0 00000100:00100000:0.0:1788652322.442341:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627779968 00000100:00100000:0.0:1788652322.442351:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627779968 00000100:00100000:0.0:1788652322.442407:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788652322.442417:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875537627779968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652322.442480:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875537627779968:12345-0@lo:400:kworker.0 Request processed in 65us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652322.442498:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788652322.442764:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe74ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627779840:0@lo:400:kworker.0 00000100:00100000:3.0:1788652322.442824:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652322.442867:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b04f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627780352:0@lo:400:kworker.0 00000100:00100000:2.0:1788652322.442896:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652322.442909:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652322.442972:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627779840 00000100:00100000:3.0:1788652322.442977:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627779840 00000100:00100000:3.0:1788652322.443019:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788652322.443027:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+19:3305:x1875537627779840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652322.443044:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875537627779968:0@lo:400:kworker.0 00000100:00100000:3.0:1788652322.443102:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+19:3305:x1875537627779840:12345-0@lo:400:kworker.0 Request processed in 74us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652322.443108:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627780224 00000100:00100000:3.0:1788652322.443114:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788652322.443118:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627780224 00000100:00100000:3.0:1788652322.443200:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627780480 00000100:00100000:3.0:1788652322.443207:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627780480 00000100:00100000:3.0:1788652322.443239:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788652322.443247:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627780224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652322.443302:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627780224:12345-0@lo:400:kworker.0 Request processed in 55us (2270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652322.443309:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788652322.443324:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788652322.443330:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627780480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652322.443367:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f344000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627780480:12345-0@lo:400:kworker.0 Request processed in 37us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652322.443373:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1788652322.443682:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788652322.443688:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788652322.443691:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652322.443720:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe74ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627779840:0@lo:400:kworker.0 00000100:00100000:3.0:1788652322.443765:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b04ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627780224:0@lo:400:kworker.0 00000100:00100000:3.0:1788652322.443854:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627780352 00000100:00100000:3.0:1788652322.443859:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627780352 00000100:00100000:3.0:1788652322.443897:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788652322.443904:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81f24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627780352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652322.443950:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81f24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627780352:12345-0@lo:400:kworker.0 Request processed in 47us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652322.443956:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1788652322.443976:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652322.443992:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b04f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627780352:0@lo:400:kworker.0 00000100:00100000:1.0:1788652322.444058:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b04ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627780480:0@lo:400:kworker.0 00000001:00080000:2.0:1788652322.484586:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1788652322.484618:0:5857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788652322.484691:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788652322.484706:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788652322.489120:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652322.489252:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603654656 00000100:00100000:1.0:1788652322.489283:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603654656 00000100:00100000:1.0:1788652322.489366:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 290 00000100:00100000:1.0:1788652322.489383:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2347:x1875537603654656:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652322.489493:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2347:x1875537603654656:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 113us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652322.489501:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 290 00000100:00100000:3.0:1788652322.489634:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652322.489863:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603654912 00000100:00100000:2.0:1788652322.489870:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603654912 00000100:00100000:2.0:1788652322.489924:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 79 00000100:00100000:2.0:1788652322.489933:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81f26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2347:x1875537603654912:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652322.489982:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81f26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2347:x1875537603654912:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 50us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652322.489989:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 79 00000100:00100000:3.0:1788652322.490664:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00080000:1.0:1788652322.492495:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788652322.493138:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603654784 00000100:00100000:2.0:1788652322.493153:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603654784 00000100:00100000:2.0:1788652322.493267:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 80 00000100:00100000:2.0:1788652322.493279:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81f24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2347:x1875537603654784:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652322.493381:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81f24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2347:x1875537603654784:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 104us (2719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652322.493420:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 80 00000100:00080000:1.0:1788652322.493544:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788652322.953916:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788652322.953956:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627780608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788652322.954268:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652322.954323:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627780608 00000100:00100000:2.0:1788652322.954336:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627780608 00000100:00100000:2.0:1788652322.954418:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788652322.954433:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81f24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627780608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788652322.954480:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788652322.954578:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81f24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627780608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652322.954585:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788652322.955075:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f345f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627780608:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788652323.080066:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652323.976168:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788652323.976199:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627780736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788652323.976277:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652323.976714:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627780736 00000100:00100000:2.0:1788652323.976734:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627780736 00000100:00100000:2.0:1788652323.976831:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788652323.976844:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81f27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627780736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788652323.976895:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788652323.976999:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81f27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627780736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652323.977006:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788652323.977228:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f346680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627780736:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788652324.104202:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652325.128075:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652326.152944:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788652326.343446:0:12289:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 19:52:03 (1788652323) 00010000:00010000:0.0:1788652327.176439:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652327.562882:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe81f24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627780864:0@lo:400:kworker.0 00000100:00100000:1.0:1788652327.562882:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe81f24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875537627780992:0@lo:400:kworker.0 00000100:00100000:2.0:1788652327.563055:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe81f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627781120:0@lo:400:kworker.0 00000100:00100000:0.0:1788652327.563172:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe81f26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627781248:0@lo:400:kworker.0 00000100:00100000:1.0:1788652327.571075:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652327.571210:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe81f26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627781504:0@lo:400:kworker.0 00000100:00100000:1.0:1788652327.571250:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652327.571323:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627781504 00000100:00100000:1.0:1788652327.571332:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627781504 00000100:00100000:1.0:1788652327.571397:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788652327.571480:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627781504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652327.571609:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627781504:12345-0@lo:400:kworker.0 Request processed in 132us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652327.571616:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1788652327.571703:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788652327.571740:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe81f26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627781504:0@lo:400:kworker.0 00000100:00100000:3.0:1788652327.572114:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652327.572274:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe81f27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627781376:0@lo:400:kworker.0 00000100:00100000:3.0:1788652327.572311:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652327.572408:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627780864 00000100:00100000:3.0:1788652327.572413:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627780864 00000100:00100000:3.0:1788652327.572447:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788652327.572454:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:3305:x1875537627780864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652327.572495:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:3305:x1875537627780864:12345-0@lo:400:kworker.0 Request processed in 41us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652327.572502:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788652327.572527:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627780992 00000100:00100000:1.0:1788652327.572527:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627781376 00000100:00100000:3.0:1788652327.572531:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627780992 00000100:00100000:1.0:1788652327.572541:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627781376 00000100:00100000:3.0:1788652327.572555:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788652327.572561:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875537627780992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652327.572573:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788652327.572578:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81f27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627781376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652327.572596:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875537627780992:12345-0@lo:400:kworker.0 Request processed in 36us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652327.572608:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788652327.572621:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81f27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627781376:12345-0@lo:400:kworker.0 Request processed in 42us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652327.572627:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:1.0:1788652327.572643:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788652327.575333:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe81f24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875537627780992:0@lo:400:kworker.0 00000100:00100000:1.0:1788652327.575465:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe81f24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627780864:0@lo:400:kworker.0 00000100:00100000:1.0:1788652327.575481:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe81f27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627781376:0@lo:400:kworker.0 00000100:00100000:2.0:1788652327.576937:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652327.577076:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627781120 00000100:00100000:2.0:1788652327.577084:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627781120 00000100:00100000:2.0:1788652327.577149:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788652327.577159:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627781120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652327.577540:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f347100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627781120:12345-0@lo:400:kworker.0 Request processed in 382us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652327.577549:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1788652327.577587:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652327.577625:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe81f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627781120:0@lo:400:kworker.0 00000100:00100000:0.0:1788652327.588062:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652327.588214:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627781248 00000100:00100000:1.0:1788652327.588225:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627781248 00000100:00100000:1.0:1788652327.588304:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788652327.588315:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a21aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627781248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652327.588384:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a21aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627781248:12345-0@lo:400:kworker.0 Request processed in 72us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652327.588391:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1788652327.588481:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788652327.590032:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe81f26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627781248:0@lo:400:kworker.0 00000100:00100000:3.0:1788652327.610677:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652327.610721:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652327.610766:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652327.610908:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652327.610973:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603655296 00000100:00100000:1.0:1788652327.610983:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603655296 00000100:00100000:1.0:1788652327.611048:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 83 00000100:00100000:1.0:1788652327.611059:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81f25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2346:x1875537603655296:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652327.611144:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81f25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2346:x1875537603655296:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 87us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652327.611151:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 83 00000100:00080000:1.0:1788652327.611176:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788652327.614035:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603655040 00000100:00100000:2.0:1788652327.614050:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603655040 00000100:00100000:2.0:1788652327.614128:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 292 00000100:00100000:2.0:1788652327.614138:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2346:x1875537603655040:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652327.614216:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2346:x1875537603655040:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 79us (3548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652327.614223:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 292 00000100:00100000:3.0:1788652327.618593:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652327.619599:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603655424 00000100:00100000:2.0:1788652327.619610:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603655424 00000100:00100000:2.0:1788652327.619677:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 84 00000100:00100000:2.0:1788652327.619686:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81f26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2346:x1875537603655424:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652327.619763:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81f26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2346:x1875537603655424:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 77us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652327.619787:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 84 00000100:00080000:3.0:1788652327.620254:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788652327.622571:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603655552 00000100:00100000:0.0:1788652327.622586:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603655552 00000100:00100000:0.0:1788652327.623188:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603655168 00000100:00100000:0.0:1788652327.623194:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603655168 00000100:00100000:2.0:1788652327.623239:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 141 00000100:00100000:2.0:1788652327.623252:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81f27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eb94160-5684-49f0-9e45-fbf338e18f8d+6:2346:x1875537603655552:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652327.623332:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81f27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eb94160-5684-49f0-9e45-fbf338e18f8d+6:2346:x1875537603655552:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 83us (12565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652327.623341:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 141 00000100:00100000:2.0:1788652327.623373:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 142 00000100:00100000:2.0:1788652327.623381:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81f26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+13:2346:x1875537603655168:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652327.623415:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81f26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+13:2346:x1875537603655168:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 35us (12508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652327.623435:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 142 00000100:00080000:3.0:1788652327.633028:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652328.072662:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627781632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788652328.072751:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652328.072815:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627781632 00000100:00100000:2.0:1788652328.072822:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627781632 00000100:00100000:2.0:1788652328.072875:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788652328.072885:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627781632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788652328.072920:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788652328.072960:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f346680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627781632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652328.072967:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788652328.073043:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f346d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627781632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788652328.079952:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652328.082422:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603655808 00000100:00100000:2.0:1788652328.082436:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603655808 00000100:00100000:2.0:1788652328.082514:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 137 00000100:00100000:2.0:1788652328.082525:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+13:11282:x1875537603655808:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788652328.082547:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652328.082568:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7ea4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0a49 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652328.082641:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7eab lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652328.082655:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7eab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652328.082668:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7eab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652328.082708:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7eb2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652328.082731:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652328.082738:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652328.083089:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7eb9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652328.083099:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652328.083106:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652328.083115:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788652328.084458:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7eab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652328.084472:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7eab lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652328.084480:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7eab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652328.084486:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215f400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652328.084491:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7eab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652328.084515:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7eab lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652328.084532:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cbe48da0300) 00010000:00010000:2.0:1788652328.084535:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652328.084541:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7eab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652328.084547:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a7eab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652328.084561:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652328.084567:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7eb2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652328.084572:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652328.084577:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652328.084580:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652328.084586:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7eb2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652328.084593:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cbe485ac500) 00010000:00010000:2.0:1788652328.084596:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652328.084598:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7eb2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652328.084614:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a7eb2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652328.088084:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a7ea4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a49 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652328.088112:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7eb9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a49 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652328.088121:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbe7fde3200) 00010000:00010000:2.0:1788652328.088125:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652328.088129:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215e200, rc 0) 00000100:00100000:2.0:1788652328.089470:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+15:11282:x1875537603655808:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 5697us (8289us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788652328.089489:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 137 00000100:00100000:2.0:1788652328.095326:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652328.095491:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603655936 00000100:00100000:1.0:1788652328.095501:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603655936 00000100:00100000:1.0:1788652328.095561:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 138 00000100:00100000:1.0:1788652328.095583:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+15:11282:x1875537603655936:12345-192.168.203.50@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788652328.095706:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f346d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+15:11282:x1875537603655936:12345-192.168.203.50@tcp:59:lhsmtool_posix.0 Request processed in 124us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652328.095713:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 138 00000100:00100000:3.0:1788652328.096748:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652328.096849:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603656064 00000100:00100000:1.0:1788652328.096857:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603656064 00000100:00100000:1.0:1788652328.096992:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:1.0:1788652328.097003:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe494ad050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+15:2349:x1875537603656064:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652328.097016:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652328.097039:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a7eb9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a49 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652328.097058:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbe7fde3200) 00010000:00010000:1.0:1788652328.097064:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652328.097303:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe494ad050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+14:2349:x1875537603656064:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 300us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652328.097311:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 10 00010000:00010000:3.0:1788652328.201140:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788652328.648619:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788652328.648643:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788652328.649194:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788652328.649205:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788652329.096961:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe81f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627781760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788652329.097060:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652329.097228:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627781760 00000100:00100000:2.0:1788652329.097239:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627781760 00000100:00100000:2.0:1788652329.097322:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788652329.097334:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81f27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627781760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788652329.097387:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788652329.097576:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81f27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627781760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 243us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652329.097584:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788652329.097820:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe81f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627781760:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788652329.097919:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788652329.224001:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652330.249859:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652330.368364:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652330.368580:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603656192 00000100:00100000:1.0:1788652330.368590:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603656192 00000100:00100000:1.0:1788652330.368658:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 139 00000100:00100000:1.0:1788652330.368668:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+14:11324:x1875537603656192:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1788652330.368688:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652330.368708:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7ec7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0a50 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.368768:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7ece lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.368806:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7ece lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788652330.368807:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788652330.368818:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7ece lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.368833:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7ed5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.368915:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.368926:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.369110:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7ece lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.369118:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7ece lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.369124:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7ece lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.369130:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c8000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652330.369134:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7ece lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.369142:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7ece lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.369154:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe48da0100) 00010000:00010000:1.0:1788652330.369163:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652330.369169:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7ece lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.369175:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7ece lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.369186:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.369192:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7ed5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.369197:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.369202:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652330.369205:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.369211:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7ed5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.369218:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cbe48da0e00) 00010000:00010000:1.0:1788652330.369220:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652330.369223:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7ed5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.369229:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7ed5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.369259:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7ec7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a50 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.369282:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe48da0100) 00010000:00010000:1.0:1788652330.369285:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652330.369289:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7ec7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a50 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.369299:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c9e00, rc 0) 00000100:00100000:1.0:1788652330.369373:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f345f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+14:11324:x1875537603656192:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 706us (1027us total) trans 0 rc 301/301 00000100:00100000:1.0:1788652330.369380:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 139 00000100:00100000:0.0:1788652330.385038:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652330.386081:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603656448 00000100:00100000:2.0:1788652330.386152:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603656448 00000100:00100000:2.0:1788652330.386221:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 140 00000100:00100000:2.0:1788652330.386230:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe43648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+14:11324:x1875537603656448:12345-192.168.203.50@tcp:36:lfs.0 00010000:00010000:2.0:1788652330.386285:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652330.386310:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52925000/0x340ed74ef02a7845 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0889 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.386326:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe48da0100) 00010000:00010000:2.0:1788652330.386331:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788652330.386542:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7edc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.386556:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7e9d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a42 expref: 5 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.386564:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7edc lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.386601:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7e9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a42 expref: 5 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.386615:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7e9d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a42 expref: 5 pid: 5836 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652330.386629:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f345180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875537627781888:192.168.203.50@tcp:104: 00000100:00100000:2.0:1788652330.388496:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe41648240 going to sleep for 11 seconds 00000100:00100000:3.0:1788652330.389963:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652330.390042:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f345180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875537627781888:192.168.203.50@tcp:104: 00000100:00100000:1.0:1788652330.390043:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603656576 00000100:00100000:1.0:1788652330.390051:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603656576 00010000:00010000:2.0:1788652330.390079:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7edc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.390098:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7e9d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a42 expref: 6 pid: 5836 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652330.390140:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 59 00000100:00100000:1.0:1788652330.390150:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3eb94160-5684-49f0-9e45-fbf338e18f8d+6:2347:x1875537603656576:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652330.390164:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652330.390172:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7e9d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a42 expref: 6 pid: 5836 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.390185:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7e9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a42 expref: 6 pid: 5836 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.390208:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7e9d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a42 expref: 6 pid: 5836 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.390234:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe48da0100) 00010000:00010000:1.0:1788652330.390240:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7edc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.390249:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7edc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.390255:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7edc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.390281:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652330.390324:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2347:x1875537603656576:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 176us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652330.390331:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 59 00000100:00080000:3.0:1788652330.390453:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788652330.392013:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7edc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.392026:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7edc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.392054:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7ee3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.392067:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.392078:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652330.393139:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788652330.393154:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7edc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.393161:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7edc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.393167:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7edc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.393172:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe40031a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652330.393177:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7edc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.393184:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7edc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.393204:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe48da0100) 00010000:00010000:2.0:1788652330.393206:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652330.393211:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7edc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.393217:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a7edc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788652330.393236:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b322342 reply state 000000001866f97d transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652330.393244:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788652330.393356:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe43648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+15:11324:x1875537603656448:12345-192.168.203.50@tcp:36:lfs.0 Request processed in 7110us (8311us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788652330.393365:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 140 00010000:00010000:2.0:1788652330.400048:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.400066:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7ee3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.400074:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7ee3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.400080:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe40031c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652330.400085:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7ee3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.400094:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7ee3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.400136:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cbe485ac500) 00010000:00010000:2.0:1788652330.400140:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652330.400145:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7ee3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.400153:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a7ee3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652330.513688:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652330.513821:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603656704 00000100:00100000:3.0:1788652330.513832:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603656704 00000100:00100000:3.0:1788652330.513900:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 141 00000100:00100000:3.0:1788652330.513912:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4364bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+14:11332:x1875537603656704:12345-192.168.203.50@tcp:101:lctl.0 00010000:00010000:3.0:1788652330.513938:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652330.513964:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7eea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0a57 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.514034:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7ef1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.514067:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.514078:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652330.514118:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788652330.514122:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788652330.514147:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.514172:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7eea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a57 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.514189:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a57 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.514198:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe7fde3500) 00010000:00010000:3.0:1788652330.514200:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788652330.514204:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5000, rc 0) 00000100:00100000:3.0:1788652330.514268:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4364bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+15:11332:x1875537603656704:12345-192.168.203.50@tcp:101:lctl.0 Request processed in 359us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652330.514276:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 141 00000100:00100000:3.0:1788652330.599298:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652330.599419:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603656832 00000100:00100000:1.0:1788652330.599428:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603656832 00000100:00100000:1.0:1788652330.599613:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 142 00000100:00100000:1.0:1788652330.599625:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81f24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+15:11338:x1875537603656832:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:1.0:1788652330.599646:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652330.599667:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7ef8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0a5e expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.599736:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7eff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.599751:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7eff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.599764:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7eff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.600582:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7f06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.600597:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7f06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.600606:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7f06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.601157:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7f0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.601168:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7f0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.601176:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7f0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652330.601213:0:6701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788652330.601217:0:6701:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788652330.601238:0:6701:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7f0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.601250:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7eff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.601257:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7eff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.601264:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7eff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.601284:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652330.601288:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7eff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.601295:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7eff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.601307:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe7fde3500) 00010000:00010000:1.0:1788652330.601311:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652330.601315:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7eff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.601321:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7eff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.601332:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7f06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.601338:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7f06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.601355:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7f06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.601360:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652330.601363:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7f06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.601369:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7f06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.602726:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cbe48da0e00) 00010000:00010000:1.0:1788652330.602730:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652330.602737:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7f06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.602745:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7f06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.602808:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7ef8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a5e expref: 17 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.602824:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7f0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a5e expref: 16 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.602862:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:1.0:1788652330.602865:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788652330.602867:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c8000, rc 0) 00000100:00100000:1.0:1788652330.602939:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81f24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+16:11338:x1875537603656832:12345-192.168.203.50@tcp:101:bash.0 Request processed in 3315us (3650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652330.602948:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 142 00000100:00100000:2.0:1788652330.608751:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652330.608936:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603657088 00000100:00100000:3.0:1788652330.608945:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603657088 00000100:00100000:3.0:1788652330.609005:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 143 00000100:00100000:3.0:1788652330.609015:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+16:11338:x1875537603657088:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:3.0:1788652330.609049:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652330.609079:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7f14 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0a65 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.609196:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7f1b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.609211:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7f1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.609222:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7f1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.609287:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7f22 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.609296:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7f22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.609302:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7f22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788652330.610985:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788652330.611260:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a7f29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.611276:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a7f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.611288:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a7f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.611338:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7f1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.611358:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7f1b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.611364:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7f1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.611369:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652330.611374:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7f1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.611381:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7f1b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.611395:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:3.0:1788652330.611398:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652330.611403:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7f1b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.611409:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7f1b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788652330.611423:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090dbd367 reply state 00000000c5941ff5 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7f22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652330.611432:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788652330.611468:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7f14 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a65 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.611495:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a7f29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a65 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.611503:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3d00) 00010000:00010000:3.0:1788652330.611506:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788652330.611508:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5200, rc 0) 00000100:00100000:3.0:1788652330.611733:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f345180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+19:11338:x1875537603657088:12345-192.168.203.50@tcp:101:bash.0 Request processed in 2718us (2991us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1788652330.611742:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 143 00010000:00010000:1.0:1788652330.615817:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7f22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.615839:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7f22 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.615847:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7f22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.615871:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652330.615877:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7f22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.615884:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7f22 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.615901:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cbe7fde3a00) 00010000:00010000:1.0:1788652330.615904:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652330.615909:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7f22 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.615915:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7f22 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652330.622051:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652330.622161:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603657216 00000100:00100000:1.0:1788652330.622171:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603657216 00000100:00080000:3.0:1788652330.622299:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788652330.622444:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 47 00000100:00100000:1.0:1788652330.622455:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2348:x1875537603657216:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:1.0:1788652330.622484:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652330.622506:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eddb606b/0x340ed74ef02a7f37 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0a6c expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788652330.622536:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788652330.622554:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=347s v=(0 0) 00010000:00010000:1.0:1788652330.622560:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652330.622570:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eddb606b/0x340ed74ef02a7f37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a6c expref: 6 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.622608:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eddb606b/0x340ed74ef02a7f37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a6c expref: 6 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.622622:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c9400, rc 0) 00000100:00100000:1.0:1788652330.622682:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f345c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2348:x1875537603657216:12345-192.168.203.50@tcp:101:bash.0 Request processed in 229us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652330.622689:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 47 00000100:00100000:0.0:1788652330.625856:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652330.625986:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603657344 00000100:00100000:2.0:1788652330.625996:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603657344 00000100:00100000:2.0:1788652330.626054:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 48 00000100:00100000:2.0:1788652330.626064:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4364ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:11338:x1875537603657344:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:2.0:1788652330.626081:0:8297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652330.626101:0:8297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a7f3e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0a73 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.626133:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eddb606b/0x340ed74ef02a7f37 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a6c expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.626143:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652330.626148:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652330.626154:0:8297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a7f3e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a73 expref: 7 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.626189:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eddb606b/0x340ed74ef02a7f37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a6c expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.626216:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eddb606b/0x340ed74ef02a7f37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a6c expref: 7 pid: 6679 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652330.626230:0:8297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f347800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8297:1875537627782016:192.168.203.50@tcp:104: 00000100:00100000:2.0:1788652330.626410:0:8297:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4953f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788652330.631990:0:8297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f347800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8297:1875537627782016:192.168.203.50@tcp:104: 00010000:00010000:2.0:1788652330.632030:0:8297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a7f3e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a73 expref: 7 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.632051:0:8297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe40031a00, rc 0) 00000100:00100000:2.0:1788652330.632153:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4364ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:11338:x1875537603657344:12345-192.168.203.50@tcp:101:bash.0 Request processed in 6090us (6304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652330.632162:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 48 00000100:00100000:3.0:1788652330.635391:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652330.635620:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603657472 00000100:00100000:2.0:1788652330.635631:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603657472 00010000:00010000:2.0:1788652330.635673:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eddb606b/0x340ed74ef02a7f37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a6c expref: 7 pid: 6679 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652330.635721:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 60 00000100:00100000:2.0:1788652330.635741:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81f26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2346:x1875537603657472:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652330.635756:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652330.635818:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eddb606b/0x340ed74ef02a7f37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a6c expref: 7 pid: 6679 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.635971:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eddb606b/0x340ed74ef02a7f37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a6c expref: 7 pid: 6679 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.635998:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eddb606b/0x340ed74ef02a7f37 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a6c expref: 7 pid: 6679 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.636015:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652330.636019:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652330.636028:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a7f3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a73 expref: 6 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.636038:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a7f3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a73 expref: 6 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.636076:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a7f3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a73 expref: 6 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652330.636089:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f347800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5820:1875537627782144:192.168.203.50@tcp:105: 00000100:00100000:2.0:1788652330.636171:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4953f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788652330.639260:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f347800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5820:1875537627782144:192.168.203.50@tcp:105: 00010000:00010000:2.0:1788652330.639287:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652330.639356:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81f26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2346:x1875537603657472:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 3616us (3973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652330.639366:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 60 00000100:00100000:3.0:1788652330.642417:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652330.643210:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603657728 00000100:00100000:1.0:1788652330.643221:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603657728 00000100:00100000:1.0:1788652330.643289:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 36 00000100:00100000:1.0:1788652330.643298:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+18:11338:x1875537603657728:12345-192.168.203.50@tcp:35:bash.0 00000100:00100000:1.0:1788652330.643725:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+19:11338:x1875537603657728:12345-192.168.203.50@tcp:35:bash.0 Request processed in 427us (1318us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788652330.643733:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 36 00000100:00100000:3.0:1788652330.754887:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652330.755906:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603657984 00000100:00100000:0.0:1788652330.755918:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603657984 00000100:00100000:0.0:1788652330.755985:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 144 00000100:00100000:0.0:1788652330.755995:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe74ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+19:11348:x1875537603657984:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1788652330.756020:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652330.756054:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a7f45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0a7a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652330.756140:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788652330.756258:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a7f45 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a7a expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652330.756507:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe7fde3500) 00010000:00010000:0.0:1788652330.756511:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788652330.756517:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a7f45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a7a expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652330.756532:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e57a00, rc 0) 00000100:00100000:0.0:1788652330.756653:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe74ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+20:11348:x1875537603657984:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 657us (1774us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1788652330.756660:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 144 00000100:00100000:0.0:1788652330.762181:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652330.762299:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603658240 00000100:00100000:3.0:1788652330.762309:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603658240 00000100:00100000:3.0:1788652330.762371:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 37 00000100:00100000:3.0:1788652330.762382:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe43648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+20:11348:x1875537603658240:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:3.0:1788652330.762630:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe43648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+21:11348:x1875537603658240:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 248us (458us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788652330.762638:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 37 00000100:00100000:3.0:1788652330.850828:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652330.851079:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603658368 00000100:00100000:1.0:1788652330.851217:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603658368 00000100:00100000:1.0:1788652330.851285:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 145 00000100:00100000:1.0:1788652330.851296:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+21:11354:x1875537603658368:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1788652330.851323:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652330.851353:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7f53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0a81 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.851422:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7f5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.851449:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7f5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.851461:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7f5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652330.851498:0:6701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788652330.851502:0:6701:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788652330.851522:0:6701:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7f5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.851550:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7f53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a81 expref: 23 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.851570:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7f5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a81 expref: 22 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.851580:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:1.0:1788652330.851583:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788652330.851586:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c9e00, rc 0) 00000100:00100000:1.0:1788652330.851719:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+22:11354:x1875537603658368:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 424us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652330.851737:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 145 00000100:00100000:0.0:1788652330.857747:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652330.858020:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603658624 00000100:00100000:3.0:1788652330.858351:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603658624 00000100:00100000:3.0:1788652330.858456:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 146 00000100:00100000:3.0:1788652330.858466:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe43648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+22:11354:x1875537603658624:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1788652330.858497:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652330.858517:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7f61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0a88 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.858613:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7f68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.858626:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.858638:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652330.858648:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788652330.858865:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a7f61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a88 expref: 25 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.858887:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7f68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a88 expref: 24 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.858959:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3d00) 00010000:00010000:3.0:1788652330.858963:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788652330.858967:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e4c00, rc 0) 00000100:00100000:3.0:1788652330.859038:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe43648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+24:11354:x1875537603658624:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 572us (1309us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1788652330.859046:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 146 00000100:00100000:2.0:1788652330.865429:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652330.865477:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652330.865552:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603659008 00000100:00100000:1.0:1788652330.865562:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603659008 00000100:00100000:1.0:1788652330.865628:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:1.0:1788652330.865638:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f344a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+24:2346:x1875537603659008:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652330.865653:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652330.865690:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a7f68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a88 expref: 24 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.865710:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3d00) 00010000:00010000:1.0:1788652330.865715:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652330.865799:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f344a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+23:2346:x1875537603659008:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 162us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652330.865807:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:3.0:1788652330.866307:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603658880 00000100:00100000:3.0:1788652330.866313:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603658880 00000100:00100000:3.0:1788652330.866361:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 147 00000100:00100000:3.0:1788652330.866379:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+23:11354:x1875537603658880:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1788652330.866399:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652330.866416:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7f76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0a8f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.866507:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7f7d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.866522:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7f7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.866532:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7f7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652330.866544:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788652330.866667:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7f76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a8f expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.866682:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7f7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a8f expref: 25 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.866690:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3d00) 00010000:00010000:3.0:1788652330.866693:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788652330.866696:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5400, rc 0) 00000100:00100000:3.0:1788652330.866731:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f347800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+25:11354:x1875537603658880:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 354us (1312us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788652330.866738:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 147 00000100:00100000:2.0:1788652330.874646:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652330.874740:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603659136 00000100:00100000:1.0:1788652330.874750:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603659136 00000100:00100000:1.0:1788652330.874840:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00100000:1.0:1788652330.874851:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2347:x1875537603659136:12345-192.168.203.50@tcp:1:lfs.0 00010000:00010000:1.0:1788652330.874893:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060bcd8ed/0x340ed74ef02a7f8b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.874922:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a7f3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a73 expref: 6 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.874931:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652330.874936:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788652330.874941:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060bcd8ed/0x340ed74ef02a7f8b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.874976:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a7f3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a73 expref: 6 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.874991:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a7f3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a73 expref: 6 pid: 8297 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652330.875020:0:6678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b04c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6678:1875537627782272:192.168.203.50@tcp:104: 00000100:00100000:1.0:1788652330.875934:0:6678:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe49d3c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652330.877829:0:6678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b04c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6678:1875537627782272:192.168.203.50@tcp:104: 00010000:00010000:1.0:1788652330.877856:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000060bcd8ed/0x340ed74ef02a7f8b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652330.879322:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652330.879420:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603659264 00000100:00100000:0.0:1788652330.879428:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603659264 00002000:00100000:0.0:1788652330.879480:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8cbe7f345880 x1875537603659264/t0(0) o4->20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp:716/0 lens 504/0 e 0 to 0 dl 1788652341 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788652330.879490:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe7f345880 with x1875537603659264 ext(0->12) 00010000:00010000:0.0:1788652330.879499:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a7f3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a73 expref: 7 pid: 8297 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652330.879515:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a7f3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a73 expref: 7 pid: 8297 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788652330.879541:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cbe7f345880 00000100:00100000:0.0:1788652330.879577:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:0.0:1788652330.879588:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f345880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2346:x1875537603659264:12345-192.168.203.50@tcp:4:lfs.0 00000100:00100000:0.0:1788652330.880246:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f345880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:2346:x1875537603659264:12345-192.168.203.50@tcp:4:lfs.0 Request processed in 657us (928us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788652330.880255:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 2 00002000:00100000:0.0:1788652330.880262:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8cbe7f345880 x1875537603659264/t4294967305(0) o4->20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp:716/0 lens 504/448 e 0 to 0 dl 1788652341 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788652330.880271:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe7f345880 with x1875537603659264 ext(0->12) 00010000:00010000:0.0:1788652330.880278:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a7f3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a73 expref: 9 pid: 8297 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652330.880291:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a7f3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a73 expref: 9 pid: 8297 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788652330.880298:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cbe7f345880 00000100:00100000:2.0:1788652330.883748:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652330.883879:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603659392 00000100:00100000:3.0:1788652330.883889:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603659392 00010000:00010000:3.0:1788652330.883955:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a7f3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a73 expref: 9 pid: 8297 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652330.884003:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 61 00000100:00100000:3.0:1788652330.884015:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a404000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:2346:x1875537603659392:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652330.884030:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788652330.884051:0:5820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788652330.884054:0:5820:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788652329 00002000:00010000:3.0:1788652330.884057:0:5820:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788652329 00002000:00010000:3.0:1788652330.884059:0:5820:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788652329 00010000:00010000:3.0:1788652330.884066:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a7f3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a73 expref: 9 pid: 8297 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.884081:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a7f3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a73 expref: 9 pid: 8297 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.884116:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a7f3e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a73 expref: 9 pid: 8297 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.884133:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788652330.884139:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788652330.884145:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000060bcd8ed/0x340ed74ef02a7f8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.884155:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060bcd8ed/0x340ed74ef02a7f8b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652330.884202:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652330.884251:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a404000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2346:x1875537603659392:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 238us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652330.884258:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 61 00010000:00010000:2.0:1788652330.884448:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000060bcd8ed/0x340ed74ef02a7f8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.884459:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060bcd8ed/0x340ed74ef02a7f8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.884486:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060bcd8ed/0x340ed74ef02a7f8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.884494:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060bcd8ed/0x340ed74ef02a7f8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.884503:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060bcd8ed/0x340ed74ef02a7f8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.884512:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9800 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652330.884517:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060bcd8ed/0x340ed74ef02a7f8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.884526:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060bcd8ed/0x340ed74ef02a7f8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.884552:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060bcd8ed/0x340ed74ef02a7f8b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.884559:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060bcd8ed/0x340ed74ef02a7f8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652330.884607:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f346300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2347:x1875537603659136:12345-192.168.203.50@tcp:1:lfs.0 Request processed in 9758us (9970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652330.884615:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00100000:1.0:1788652330.889062:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652330.889248:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603659648 00000100:00100000:3.0:1788652330.889258:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603659648 00000100:00100000:3.0:1788652330.889317:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 38 00000100:00100000:3.0:1788652330.889327:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe47b48050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+25:11354:x1875537603659648:12345-192.168.203.50@tcp:35:lfs.0 00000004:00010000:3.0:1788652330.889424:0:5839:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7f7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a8f expref: 25 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788652330.889670:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1788652330.889719:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788652330.891430:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1788652330.891515:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7f92 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.891535:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a7f29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a65 expref: 29 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.891544:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7f92 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.891583:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a7f29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a65 expref: 29 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.891603:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a7f29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a65 expref: 29 pid: 5836 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652330.891618:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a284700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5839:1875537627782400:192.168.203.50@tcp:104: 00000100:00100000:2.0:1788652330.891872:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4953f240 going to sleep for 11 seconds 00000100:00100000:0.0:1788652330.896232:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652330.896322:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603659776 00000100:00100000:1.0:1788652330.896332:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603659776 00010000:00010000:1.0:1788652330.896397:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a7f29 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a65 expref: 30 pid: 5836 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652330.896437:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 62 00000100:00100000:1.0:1788652330.896447:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+30:2346:x1875537603659776:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652330.896462:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652330.896468:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a7f29 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a65 expref: 30 pid: 5836 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.896480:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a7f29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a65 expref: 30 pid: 5836 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.896501:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3d00) 00010000:00010000:1.0:1788652330.896506:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7f92 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.896531:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7f92 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.896539:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7f92 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.896558:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652330.896615:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+30:2346:x1875537603659776:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 168us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652330.896622:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 62 00010000:00010000:2.0:1788652330.898653:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a7f29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a65 expref: 29 pid: 5836 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652330.898676:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a284700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5839:1875537627782400:192.168.203.50@tcp:104: 00010000:00010000:2.0:1788652330.898702:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7f92 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.898712:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7f92 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.898719:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7f92 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788652330.899021:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788652330.899416:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1788652330.899534:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a284700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1875537627782528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788652330.899594:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652330.899629:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4953f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652330.899704:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627782528 00000100:00100000:3.0:1788652330.899711:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627782528 00000100:00100000:3.0:1788652330.899808:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788652330.899817:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1875537627782528:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788652330.899889:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1875537627782528:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 73us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652330.900013:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a284700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1875537627782528:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788652330.900467:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1788652330.900525:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a284700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1875537627782656:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788652330.900553:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652330.900582:0:5840:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788652330.900589:0:5840:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788652330.900609:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4953f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788652330.901306:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788652330.901400:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627782656 00000100:00100000:2.0:1788652330.901406:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627782656 00000100:00100000:2.0:1788652330.901448:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788652330.901456:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1875537627782656:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1788652330.901692:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788652330.902052:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5839:x1875537627782656:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 593us (1494us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788652330.902060:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788652330.902617:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a284700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1875537627782656:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788652330.903010:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1788652330.903062:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7f92 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.903073:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7f92 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.903081:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7f92 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.903087:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe40030e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652330.903091:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7f92 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.903215:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7f92 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.903232:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3d00) 00010000:00010000:2.0:1788652330.903236:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788652330.903241:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7f92 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652330.903249:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a7f92 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788652330.903479:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788652330.903643:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1788652330.903655:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 347886882903ns, next at 348886880673ns, rc = 0 00000001:00080000:2.0:1788652330.903662:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1788652330.903696:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3d00) 00010000:00010000:2.0:1788652330.903699:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788652330.903707:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a7f7d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a8f expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652330.904081:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe47b48050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+32:11354:x1875537603659648:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 14752us (15027us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1788652330.904101:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 38 00000020:00080000:2.0:1788652330.904106:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788652330.907371:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652330.907460:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603659904 00000100:00100000:1.0:1788652330.907469:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603659904 00000100:00100000:1.0:1788652330.907548:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 148 00000100:00100000:1.0:1788652330.907558:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+32:11354:x1875537603659904:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1788652330.907581:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652330.907603:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7f99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0a96 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.907659:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7f99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a96 expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.907673:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7f99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a96 expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652330.907691:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:1.0:1788652330.907694:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788652330.907698:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c9800, rc 0) 00000100:00100000:1.0:1788652330.907768:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+33:11354:x1875537603659904:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 211us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652330.907850:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 148 00000100:00100000:0.0:1788652330.911542:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652330.911618:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603660160 00000100:00100000:2.0:1788652330.911627:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603660160 00000100:00100000:2.0:1788652330.911684:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 39 00000100:00100000:2.0:1788652330.911695:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+33:11354:x1875537603660160:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:2.0:1788652330.911971:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+34:11354:x1875537603660160:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 277us (438us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788652330.911978:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 39 00000100:00100000:0.0:1788652331.009116:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652331.009282:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603660416 00000100:00100000:3.0:1788652331.009292:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603660416 00000100:00100000:3.0:1788652331.009394:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 149 00000100:00100000:3.0:1788652331.009405:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+34:11364:x1875537603660416:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1788652331.009443:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652331.009465:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7fa0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0a9d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652331.009556:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788652331.009682:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7fa0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a9d expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.009697:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe7fde3500) 00010000:00010000:3.0:1788652331.009701:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788652331.009706:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7fa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a9d expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.009721:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e4400, rc 0) 00000100:00100000:3.0:1788652331.009855:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+35:11364:x1875537603660416:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 451us (748us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1788652331.009863:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 149 00000100:00100000:2.0:1788652331.013199:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652331.013304:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603660544 00000100:00100000:1.0:1788652331.013314:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603660544 00000100:00100000:1.0:1788652331.013404:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 150 00000100:00100000:1.0:1788652331.013415:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+35:11364:x1875537603660544:12345-192.168.203.50@tcp:34:lfs.0 00010000:00010000:1.0:1788652331.013494:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7fae lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.013509:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7fae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.013520:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7fae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.013534:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7fb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.013540:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.013546:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.013636:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7fbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.013645:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7fbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.013652:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7fbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788652331.013711:0:6701:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7fbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.013724:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7fae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.015604:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7fae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.015613:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7fae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.015619:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652331.015625:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7fae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.015635:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7fae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.015652:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:1.0:1788652331.015654:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652331.015659:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7fae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.015666:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7fae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.015688:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.015694:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7fb5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.015718:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.015723:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652331.017248:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.017269:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7fb5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.017290:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cbe48da0000) 00010000:00010000:1.0:1788652331.017293:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652331.017298:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7fb5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.017305:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7fb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.017330:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7fbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.017348:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7fbc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.017355:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7fbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.017360:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c8800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652331.017363:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7fbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.017388:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7fbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.017398:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:1.0:1788652331.017400:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652331.017403:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7fbc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.017409:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7fbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652331.017522:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+35:11364:x1875537603660544:12345-192.168.203.50@tcp:34:lfs.0 Request processed in 4104us (4326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652331.017532:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 150 00000100:00100000:1.0:1788652331.023445:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652331.023524:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603660800 00000100:00100000:2.0:1788652331.023534:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603660800 00000100:00100000:2.0:1788652331.023592:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 40 00000100:00100000:2.0:1788652331.023602:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+35:11364:x1875537603660800:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:2.0:1788652331.024093:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+36:11364:x1875537603660800:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 491us (656us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788652331.024110:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 40 00000100:00100000:2.0:1788652331.077300:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652331.077416:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603661056 00000100:00100000:1.0:1788652331.077426:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603661056 00000100:00100000:1.0:1788652331.077484:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 151 00000100:00100000:1.0:1788652331.077494:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+36:11367:x1875537603661056:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1788652331.077517:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652331.077538:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7fc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0aa4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.077614:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7fca lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.077628:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7fca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.077655:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7fca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.077669:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7fd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.077676:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.077682:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.077860:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a7fd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.077880:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a7fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.077888:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a7fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652331.077909:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788652331.078009:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7fca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.078017:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7fca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.078023:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7fca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.078028:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652331.078039:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7fca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.078048:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7fca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.078061:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:1.0:1788652331.078064:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652331.078069:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7fca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.078076:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a7fca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.078089:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.078095:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7fd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.078100:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.078105:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652331.078107:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.078112:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7fd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.078120:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cbe48da0000) 00010000:00010000:1.0:1788652331.078121:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652331.078131:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7fd1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.078136:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7fd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.078184:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7fc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0aa4 expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.078201:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a7fd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0aa4 expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.078211:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:1.0:1788652331.078214:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788652331.078217:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c9600, rc 0) 00000100:00100000:1.0:1788652331.078302:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+38:11367:x1875537603661056:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 809us (1011us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1788652331.078310:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 151 00000100:00100000:1.0:1788652331.084256:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652331.084336:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603661184 00000100:00100000:3.0:1788652331.084355:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603661184 00000100:00100000:3.0:1788652331.084418:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 152 00000100:00100000:3.0:1788652331.084430:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+38:11367:x1875537603661184:12345-192.168.203.50@tcp:54:lfs.0 00010000:00010000:3.0:1788652331.084504:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7fe6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.084523:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.084534:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.084580:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.084587:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7fe6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.084593:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.084599:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652331.084604:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.084613:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7fe6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.084625:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:3.0:1788652331.084628:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788652331.084632:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7fe6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.084638:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a7fe6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652331.084737:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+38:11367:x1875537603661184:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 301us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652331.084746:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 152 00000100:00100000:2.0:1788652331.090893:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652331.091056:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603661440 00000100:00100000:1.0:1788652331.091065:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603661440 00000100:00100000:1.0:1788652331.091129:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 41 00000100:00100000:1.0:1788652331.091140:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+38:11367:x1875537603661440:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:1.0:1788652331.091389:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+39:11367:x1875537603661440:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 250us (506us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1788652331.091398:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 41 00010000:00010000:0.0:1788652331.272791:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652331.415732:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652331.416045:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603661696 00000100:00100000:1.0:1788652331.416057:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603661696 00000100:00100000:1.0:1788652331.416141:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 153 00000100:00100000:1.0:1788652331.416152:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+39:11398:x1875537603661696:12345-192.168.203.50@tcp:101:cat.0 00010000:00010000:1.0:1788652331.416175:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652331.416196:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7fed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0aab expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.416301:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7ff4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.416315:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.416327:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652331.416348:0:6701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788652331.416751:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a7fed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0aab expref: 42 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.417076:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0aab expref: 41 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.417087:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:1.0:1788652331.417090:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788652331.417094:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c9000, rc 0) 00000100:00100000:1.0:1788652331.417162:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+41:11398:x1875537603661696:12345-192.168.203.50@tcp:101:cat.0 Request processed in 1011us (1438us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788652331.417170:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 153 00000100:00100000:2.0:1788652331.425402:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652331.425495:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652331.425676:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603661952 00000100:00100000:1.0:1788652331.425711:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603661952 00000100:00100000:1.0:1788652331.425942:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 42 00000100:00100000:1.0:1788652331.425968:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+41:11398:x1875537603661952:12345-192.168.203.50@tcp:35:cat.0 00000100:00100000:3.0:1788652331.426292:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603662080 00000100:00100000:3.0:1788652331.426298:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603662080 00000100:00100000:3.0:1788652331.426346:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:3.0:1788652331.426362:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81f25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+43:2346:x1875537603662080:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652331.426374:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652331.426397:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a7ff4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0aab expref: 43 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.426416:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:3.0:1788652331.426421:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652331.426461:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+42:11398:x1875537603661952:12345-192.168.203.50@tcp:35:cat.0 Request processed in 497us (1068us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788652331.426469:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 42 00000100:00100000:3.0:1788652331.428617:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81f25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+41:2346:x1875537603662080:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 2247us (3112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652331.428641:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:2.0:1788652331.489102:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652331.489240:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603662336 00000100:00100000:0.0:1788652331.489261:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603662336 00000100:00100000:0.0:1788652331.489321:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 154 00000100:00100000:0.0:1788652331.489332:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+41:11404:x1875537603662336:12345-192.168.203.50@tcp:101:dd.0 00010000:00010000:0.0:1788652331.489366:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652331.489370:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788652331.489395:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a7f5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a81 expref: 41 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652331.489412:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:0.0:1788652331.489417:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788652331.489432:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a8002 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0ab2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652331.489961:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8009 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652331.489977:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a7fd8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0aa4 expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652331.489986:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8009 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652331.490033:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a7fd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0aa4 expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652331.490047:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a7fd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0aa4 expref: 41 pid: 5835 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652331.490059:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875537627782784:192.168.203.50@tcp:104: 00000100:00100000:0.0:1788652331.490168:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe47e113c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652331.493300:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652331.494752:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603662464 00000100:00100000:2.0:1788652331.494764:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603662464 00010000:00010000:2.0:1788652331.494843:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a7fd8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0aa4 expref: 42 pid: 5835 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652331.494889:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 63 00000100:00100000:2.0:1788652331.494899:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe494ac850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+42:2347:x1875537603662464:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652331.494915:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652331.494922:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a7fd8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0aa4 expref: 42 pid: 5835 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652331.494936:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a7fd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0aa4 expref: 42 pid: 5835 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652331.494959:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:2.0:1788652331.494965:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8009 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652331.494976:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8009 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652331.494984:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8009 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652331.495021:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652331.495089:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe494ac850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+42:2347:x1875537603662464:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 191us (1797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652331.495097:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 63 00010000:00010000:3.0:1788652331.496794:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a7fd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0aa4 expref: 41 pid: 5835 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652331.496816:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875537627782784:192.168.203.50@tcp:104: 00010000:00010000:3.0:1788652331.496840:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8009 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.496851:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8009 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.496856:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8009 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652331.496877:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788652331.497144:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a8002 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ab2 expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.497161:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8009 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ab2 expref: 41 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.497182:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:3.0:1788652331.497185:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788652331.497188:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e56e00, rc 0) 00000100:00100000:3.0:1788652331.497302:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+41:11404:x1875537603662336:12345-192.168.203.50@tcp:101:dd.0 Request processed in 7971us (8208us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788652331.497311:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 154 00000100:00100000:0.0:1788652331.502090:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652331.502192:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603662720 00000100:00100000:2.0:1788652331.502202:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603662720 00000100:00100000:2.0:1788652331.502260:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 155 00000100:00100000:2.0:1788652331.502271:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+41:11404:x1875537603662720:12345-192.168.203.50@tcp:36:dd.0 00010000:00010000:2.0:1788652331.502550:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a8017 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652331.502568:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a8017 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652331.502579:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a8017 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788652331.502648:0:11683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788652331.502674:0:11683:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006cdd22e8 reply state 00000000cea6d1c8 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a8017 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652331.502683:0:11683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788652331.502826:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+44:11404:x1875537603662720:12345-192.168.203.50@tcp:36:dd.0 Request processed in 555us (744us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788652331.502834:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 155 00000020:00080000:2.0:1788652331.502838:0:11683:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788652331.506722:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a8017 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652331.506757:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a8017 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652331.506765:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a8017 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652331.506803:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe40031e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652331.506808:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a8017 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652331.506817:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a8017 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652331.506835:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:2.0:1788652331.506838:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652331.506844:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a8017 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652331.506850:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a8017 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788652331.722452:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788652331.722461:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788652331.722676:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1788652331.722685:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788652331.784581:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652331.784864:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603662848 00000100:00100000:1.0:1788652331.784874:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603662848 00000100:00100000:1.0:1788652331.784924:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 156 00000100:00100000:1.0:1788652331.784933:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+43:11419:x1875537603662848:12345-192.168.203.50@tcp:101:stat.0 00010000:00010000:1.0:1788652331.784955:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652331.784976:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8600/0x340ed74ef02a801e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0ab9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.785040:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a8025 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.785054:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a8025 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.785067:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a8025 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.785080:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a802c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.785086:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a802c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.785092:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a802c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.785184:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a8033 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.785194:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8009 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ab2 expref: 44 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.785202:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a8033 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.785462:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8009 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ab2 expref: 44 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.785477:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8009 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ab2 expref: 44 pid: 5837 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652331.785490:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b04df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875537627782912:192.168.203.50@tcp:104: 00000100:00100000:1.0:1788652331.785591:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe49d3cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788652331.789956:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652331.790063:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603663104 00000100:00100000:2.0:1788652331.790073:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603663104 00000100:00100000:2.0:1788652331.790135:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 43 00000100:00100000:2.0:1788652331.790146:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+45:5586:x1875537603663104:12345-192.168.203.50@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788652331.790492:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+46:5586:x1875537603663104:12345-192.168.203.50@tcp:35:ldlm_bl.0 Request processed in 346us (543us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788652331.790500:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 43 00000100:00100000:0.0:1788652331.792307:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b04df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875537627782912:192.168.203.50@tcp:104: 00010000:00010000:0.0:1788652331.792350:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a8033 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652331.795092:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652331.796817:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603663232 00000100:00100000:3.0:1788652331.796831:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603663232 00010000:00010000:3.0:1788652331.796881:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8009 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ab2 expref: 46 pid: 5837 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652331.796945:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 64 00000100:00100000:3.0:1788652331.796957:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+46:2346:x1875537603663232:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652331.796973:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652331.796981:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8009 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ab2 expref: 46 pid: 5837 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.796995:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8009 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ab2 expref: 46 pid: 5837 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.797016:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8009 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ab2 expref: 46 pid: 5837 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.797034:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:3.0:1788652331.797040:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a8033 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.797062:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a8033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.797069:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a8033 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.797119:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652331.797190:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+45:2346:x1875537603663232:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 235us (2107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652331.797198:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 64 00010000:00010000:0.0:1788652331.797928:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a8033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652331.797939:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a8033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652331.797986:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788652331.797991:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788652331.798016:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a8033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652331.798030:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a8033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652331.798040:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a8025 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652331.798047:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a8025 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652331.798067:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a8025 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652331.798073:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c8200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652331.798077:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a8025 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652331.798099:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a8025 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652331.798112:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:0.0:1788652331.798115:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652331.798119:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a8025 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652331.798125:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a8025 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652331.798139:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a802c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652331.798145:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a802c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652331.798152:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a802c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652331.798156:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652331.798159:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a802c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652331.798177:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a802c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652331.798187:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cbe48da0000) 00010000:00010000:0.0:1788652331.798190:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652331.798193:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a802c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652331.798199:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a802c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652331.798240:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8600/0x340ed74ef02a801e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ab9 expref: 45 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652331.798256:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a8033 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ab9 expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652331.798264:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:0.0:1788652331.798266:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788652331.798268:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c8e00, rc 0) 00000100:00100000:0.0:1788652331.798324:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+44:11419:x1875537603662848:12345-192.168.203.50@tcp:101:stat.0 Request processed in 13390us (13752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652331.798342:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 156 00000100:00100000:2.0:1788652331.868137:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652331.868246:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603663488 00000100:00100000:3.0:1788652331.868256:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603663488 00000100:00100000:3.0:1788652331.868313:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 157 00000100:00100000:3.0:1788652331.868324:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81f26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+44:11425:x1875537603663488:12345-192.168.203.50@tcp:36:truncate.0 00010000:00010000:3.0:1788652331.868401:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652331.868430:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a8033 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ab9 expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.868450:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:3.0:1788652331.868456:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788652331.868686:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a803a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.868701:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a803a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.868710:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a803a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788652331.868826:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1788652331.868854:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f03ce267 reply state 00000000b3e325d4 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a803a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652331.868862:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788652331.868969:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81f26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+46:11425:x1875537603663488:12345-192.168.203.50@tcp:36:truncate.0 Request processed in 645us (839us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788652331.868976:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 157 00000020:00080000:3.0:1788652331.868981:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788652331.871236:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a803a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.871251:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a803a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.871258:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a803a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.871264:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652331.871268:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a803a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.871277:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a803a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.871294:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:3.0:1788652331.871297:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652331.871302:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a803a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652331.871308:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a803a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652331.988365:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652331.988453:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603663616 00000100:00100000:1.0:1788652331.988462:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603663616 00000100:00100000:1.0:1788652331.988521:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 158 00000100:00100000:1.0:1788652331.988530:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+45:11439:x1875537603663616:12345-192.168.203.50@tcp:101:stat.0 00010000:00010000:1.0:1788652331.988555:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652331.988575:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a8041 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0ac0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.988641:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a8048 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.988668:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a8048 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.988681:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a8048 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.988698:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a804f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.988705:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a804f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.988711:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a804f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.988845:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a8056 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.988854:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a8056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.988861:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a8056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652331.989033:0:6701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1788652331.989039:0:6701:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788652331.989060:0:6701:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a8056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.989071:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a8056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.989090:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a8048 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.989096:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a8048 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.989103:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a8048 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.989108:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c8200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652331.989112:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a8048 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.989119:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a8048 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.989131:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:1.0:1788652331.989134:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652331.989138:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a8048 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.989145:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a8048 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.989157:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a804f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.989163:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a804f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.989167:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a804f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.989178:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c8400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652331.989181:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a804f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.989186:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a804f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.989194:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cbe48da0000) 00010000:00010000:1.0:1788652331.989196:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652331.989199:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a804f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.989204:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a804f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.989236:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a8041 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ac0 expref: 47 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.989250:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a8056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ac0 expref: 46 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652331.989257:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:1.0:1788652331.989259:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788652331.989262:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c8c00, rc 0) 00000100:00100000:1.0:1788652331.989380:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+46:11439:x1875537603663616:12345-192.168.203.50@tcp:101:stat.0 Request processed in 851us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652331.989388:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 158 00000100:00100000:1.0:1788652332.079718:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652332.079974:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603663872 00000100:00100000:0.0:1788652332.079984:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603663872 00000100:00100000:0.0:1788652332.080070:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 159 00000100:00100000:0.0:1788652332.080081:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+46:11449:x1875537603663872:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1788652332.080114:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652332.080136:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a805d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0ac7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652332.080242:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788652332.080395:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a805d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ac7 expref: 48 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652332.080410:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe7fde3500) 00010000:00010000:0.0:1788652332.080413:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788652332.080417:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a805d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ac7 expref: 48 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652332.080431:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e57a00, rc 0) 00000100:00100000:0.0:1788652332.080498:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+47:11449:x1875537603663872:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 419us (789us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1788652332.080507:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 159 00000100:00080000:3.0:1788652332.081181:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652332.086208:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652332.086301:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603664128 00000100:00100000:1.0:1788652332.086319:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603664128 00000100:00100000:1.0:1788652332.086393:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 44 00000100:00100000:1.0:1788652332.086404:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe47b49850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+47:11449:x1875537603664128:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:1.0:1788652332.086658:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe47b49850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+48:11449:x1875537603664128:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 254us (459us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1788652332.086665:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 44 00000100:00100000:2.0:1788652332.150744:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652332.151521:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603664384 00000100:00100000:1.0:1788652332.151538:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603664384 00000100:00100000:1.0:1788652332.151678:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 160 00000100:00100000:1.0:1788652332.151692:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+48:11455:x1875537603664384:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:1.0:1788652332.151738:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652332.151768:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a806b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0ace expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.151959:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8072 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.151978:0:11683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a8056 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ac0 expref: 49 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.151989:0:11683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8072 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.152033:0:11683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a8056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ac0 expref: 49 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.152050:0:11683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a8056 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ac0 expref: 49 pid: 6701 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652332.152098:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b04c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11683:1875537627783040:192.168.203.50@tcp:104: 00000100:00100000:1.0:1788652332.152231:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe49d3c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788652332.155653:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b04c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11683:1875537627783040:192.168.203.50@tcp:104: 00010000:00010000:1.0:1788652332.155695:0:11683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8072 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652332.157547:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652332.158029:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603664512 00000100:00100000:1.0:1788652332.158043:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603664512 00010000:00010000:1.0:1788652332.158101:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a8056 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ac0 expref: 50 pid: 6701 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652332.158153:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 65 00000100:00100000:1.0:1788652332.158166:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a404000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+50:2347:x1875537603664512:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652332.158187:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652332.158196:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a8056 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ac0 expref: 50 pid: 6701 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.158210:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a8056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ac0 expref: 50 pid: 6701 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.158245:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a8056 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ac0 expref: 50 pid: 6701 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.158264:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:1.0:1788652332.158270:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8072 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.158297:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8072 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.158306:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8072 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.158352:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652332.158434:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a404000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+49:2347:x1875537603664512:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 270us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652332.158442:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 65 00010000:00010000:2.0:1788652332.159692:0:11683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8072 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.159712:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8072 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652332.159750:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788652332.160041:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a806b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ace expref: 50 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.160063:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8072 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ace expref: 49 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.160073:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:2.0:1788652332.160076:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788652332.160092:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c8400, rc 0) 00000100:00100000:2.0:1788652332.160172:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f344a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+49:11455:x1875537603664384:12345-192.168.203.50@tcp:101:bash.0 Request processed in 8482us (9456us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788652332.160182:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 160 00000100:00100000:2.0:1788652332.166144:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652332.166275:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603664768 00000100:00100000:1.0:1788652332.166290:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603664768 00000100:00100000:1.0:1788652332.166385:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 161 00000100:00100000:1.0:1788652332.166400:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe43648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+49:11455:x1875537603664768:12345-192.168.203.50@tcp:36:bash.0 00010000:00010000:1.0:1788652332.167037:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a8080 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.167060:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a8080 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.167075:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a8080 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788652332.167144:0:6701:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1788652332.167172:0:6701:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000065aa852e reply state 00000000122ea4b0 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a8080 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652332.167182:0:6701:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788652332.167308:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe43648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+52:11455:x1875537603664768:12345-192.168.203.50@tcp:36:bash.0 Request processed in 908us (1177us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788652332.167349:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 161 00000020:00080000:1.0:1788652332.167356:0:6701:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788652332.173411:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00010000:00010000:2.0:1788652332.173497:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a8080 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.173512:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a8080 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.173540:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a8080 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.173547:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c8c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652332.173552:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a8080 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.173562:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a8080 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.173586:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:2.0:1788652332.173590:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652332.173596:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a8080 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.173604:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a8080 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652332.173756:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603664896 00000100:00100000:1.0:1788652332.173803:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603664896 00000100:00100000:1.0:1788652332.173878:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 162 00000100:00100000:1.0:1788652332.173896:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+51:11455:x1875537603664896:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:1.0:1788652332.173928:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652332.173949:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a8087 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0ad5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.174068:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a808e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.174398:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8072 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ace expref: 52 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.174411:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a808e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.174458:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8072 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ace expref: 52 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.174472:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8072 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ace expref: 52 pid: 11683 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652332.174489:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4b04c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875537627783168:192.168.203.50@tcp:104: 00000100:00100000:1.0:1788652332.174599:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe49d3c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652332.178298:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652332.178378:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603665024 00000100:00100000:2.0:1788652332.178390:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603665024 00010000:00010000:2.0:1788652332.178438:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8072 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ace expref: 53 pid: 11683 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652332.178488:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 66 00000100:00100000:2.0:1788652332.178498:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+53:2347:x1875537603665024:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652332.178515:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652332.178522:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8072 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ace expref: 53 pid: 11683 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.178561:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8072 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ace expref: 53 pid: 11683 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.178588:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:2.0:1788652332.178594:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a808e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.178606:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a808e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.178615:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a808e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.178639:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652332.178699:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+53:2347:x1875537603665024:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 202us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652332.178707:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 66 00010000:00010000:1.0:1788652332.179409:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8072 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ace expref: 52 pid: 11683 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652332.179431:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4b04c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875537627783168:192.168.203.50@tcp:104: 00010000:00010000:1.0:1788652332.179456:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a808e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.179466:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a808e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.179472:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a808e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652332.179533:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788652332.179538:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788652332.179562:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a808e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.179595:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a8087 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ad5 expref: 52 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.179610:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a808e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ad5 expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.179617:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:1.0:1788652332.179620:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788652332.179622:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c9a00, rc 0) 00000100:00100000:1.0:1788652332.179679:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+51:11455:x1875537603664896:12345-192.168.203.50@tcp:101:bash.0 Request processed in 5791us (6285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652332.179687:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 162 00000100:00100000:0.0:1788652332.184173:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652332.184254:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603665280 00000100:00100000:1.0:1788652332.184266:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603665280 00000100:00100000:1.0:1788652332.184349:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 45 00000100:00100000:1.0:1788652332.184361:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+51:11455:x1875537603665280:12345-192.168.203.50@tcp:35:bash.0 00000100:00100000:1.0:1788652332.184703:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+52:11455:x1875537603665280:12345-192.168.203.50@tcp:35:bash.0 Request processed in 342us (544us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1788652332.184712:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 45 00000100:00100000:2.0:1788652332.283981:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652332.284242:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603665536 00000100:00100000:1.0:1788652332.284255:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603665536 00000100:00100000:1.0:1788652332.284342:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 163 00000100:00100000:1.0:1788652332.284353:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4924fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+52:11465:x1875537603665536:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1788652332.284385:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652332.284411:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a8095 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0adc expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652332.284525:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788652332.284681:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a8095 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0adc expref: 54 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.284699:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe7fde3500) 00010000:00010000:1.0:1788652332.284702:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788652332.284709:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a8095 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0adc expref: 54 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.284739:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c8200, rc 0) 00000100:00100000:1.0:1788652332.284875:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4924fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+53:11465:x1875537603665536:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 523us (910us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1788652332.284904:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 163 00000100:00100000:0.0:1788652332.288295:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652332.288398:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603665664 00000100:00100000:1.0:1788652332.288411:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603665664 00000100:00100000:1.0:1788652332.288486:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 164 00000100:00100000:1.0:1788652332.288497:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+53:11465:x1875537603665664:12345-192.168.203.50@tcp:34:lfs.0 00010000:00010000:1.0:1788652332.288595:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a80a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.288615:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a80a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.288629:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a80a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.288647:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a80aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.288654:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a80aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.288660:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a80aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.288814:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a80b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.288824:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a80b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.288831:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a80b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788652332.288911:0:6701:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a80b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.288927:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a80a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.288934:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a80a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.288941:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a80a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.288947:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c8400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652332.288952:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a80a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.288960:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a80a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.288974:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:1.0:1788652332.288977:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652332.288982:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a80a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.288988:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a80a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.289003:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a80aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.289009:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a80aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.289020:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a80aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.289025:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652332.289028:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a80aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.289034:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a80aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.289041:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cbe48da0000) 00010000:00010000:1.0:1788652332.289043:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652332.289046:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a80aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.289052:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a80aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.289068:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a80b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.289074:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a80b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.289079:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a80b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.289085:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652332.289088:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a80b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.289105:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a80b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.289112:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:1.0:1788652332.289115:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652332.289118:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a80b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.289123:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a80b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652332.289214:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+53:11465:x1875537603665664:12345-192.168.203.50@tcp:34:lfs.0 Request processed in 718us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652332.289224:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 164 00000100:00100000:3.0:1788652332.292185:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652332.292301:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603665920 00000100:00100000:1.0:1788652332.292315:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603665920 00000100:00100000:1.0:1788652332.292399:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 46 00000100:00100000:1.0:1788652332.292411:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+53:11465:x1875537603665920:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:1.0:1788652332.292737:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+54:11465:x1875537603665920:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 328us (568us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788652332.292745:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 46 00010000:00010000:0.0:1788652332.296323:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652332.327105:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652332.327484:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603666176 00000100:00100000:1.0:1788652332.327499:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603666176 00000100:00100000:1.0:1788652332.327580:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 165 00000100:00100000:1.0:1788652332.327592:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4924ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+54:11468:x1875537603666176:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1788652332.327623:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652332.327651:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a80b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0ae3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.328246:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a80bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.328265:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a80bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.328280:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a80bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.328296:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a80c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.328303:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a80c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.328309:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a80c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.328473:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a80cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.328483:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a80cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.328489:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a80cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652332.328500:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788652332.328626:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a80bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.328635:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a80bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.328653:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a80bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.328659:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652332.328664:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a80bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.328673:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a80bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.328687:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:1.0:1788652332.328691:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652332.328696:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a80bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.328702:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a80bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.328717:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a80c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.328723:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a80c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.329108:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a80c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.329113:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c8400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652332.329116:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a80c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.329133:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a80c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.329142:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cbe48da0000) 00010000:00010000:1.0:1788652332.329145:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652332.329148:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a80c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.329154:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a80c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.329218:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a80b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ae3 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.329234:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a80cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ae3 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.329241:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:1.0:1788652332.329243:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788652332.329246:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c8200, rc 0) 00000100:00100000:1.0:1788652332.329348:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4924ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+56:11468:x1875537603666176:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 1757us (2257us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1788652332.329358:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 165 00000100:00100000:0.0:1788652332.336135:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652332.336243:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652332.338207:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603666432 00000100:00100000:3.0:1788652332.338227:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603666432 00000100:00100000:3.0:1788652332.338342:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:3.0:1788652332.338354:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+56:2346:x1875537603666432:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652332.338374:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652332.338407:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a80cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ae3 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.338434:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:3.0:1788652332.338440:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652332.338833:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603666304 00000100:00100000:1.0:1788652332.338841:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603666304 00000100:00100000:1.0:1788652332.338940:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 166 00000100:00100000:1.0:1788652332.338952:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+56:11468:x1875537603666304:12345-192.168.203.50@tcp:54:lfs.0 00000100:00100000:3.0:1788652332.339274:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+56:2346:x1875537603666432:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 182us (2290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652332.339284:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 13 00010000:00010000:1.0:1788652332.339368:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a80db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.339387:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a80db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.339400:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a80db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.339556:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a80db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.339565:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a80db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.339572:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a80db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.339578:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652332.339583:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a80db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.339591:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a80db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.339602:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:1.0:1788652332.339605:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788652332.339610:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a80db lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.339616:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a80db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652332.339985:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+55:11468:x1875537603666304:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 1033us (3863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652332.339993:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 166 00000100:00100000:0.0:1788652332.343254:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652332.344590:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603666688 00000100:00100000:1.0:1788652332.344610:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603666688 00000100:00100000:1.0:1788652332.344852:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 47 00000100:00100000:1.0:1788652332.344862:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4926a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+55:11468:x1875537603666688:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:1.0:1788652332.345285:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4926a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+56:11468:x1875537603666688:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 421us (2043us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788652332.345293:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 47 00000100:00100000:3.0:1788652332.506568:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652332.507033:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603666944 00000100:00100000:2.0:1788652332.507115:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603666944 00000100:00100000:2.0:1788652332.507264:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 167 00000100:00100000:2.0:1788652332.507277:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+56:11486:x1875537603666944:12345-192.168.203.50@tcp:101:cat.0 00010000:00010000:2.0:1788652332.507312:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652332.507350:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a80e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0aea expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.507499:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a80e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.507537:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a80e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.507552:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a80e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652332.507569:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788652332.507752:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a80e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0aea expref: 59 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.507866:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a80e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0aea expref: 58 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.507878:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:2.0:1788652332.507881:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788652332.507886:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe40031e00, rc 0) 00000100:00100000:2.0:1788652332.507969:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+58:11486:x1875537603666944:12345-192.168.203.50@tcp:101:cat.0 Request processed in 695us (1417us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788652332.507977:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 167 00000100:00100000:0.0:1788652332.537812:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652332.538567:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603667072 00000100:00100000:1.0:1788652332.538582:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603667072 00000100:00100000:1.0:1788652332.538670:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 168 00000100:00100000:1.0:1788652332.538682:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe49268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+58:11487:x1875537603667072:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1788652332.538714:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652332.538744:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a80f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0af1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.539202:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a80fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.539220:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a80fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.539234:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a80fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652332.539300:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788652332.539304:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788652332.539338:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a80fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.539371:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a80f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0af1 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.539392:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a80fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0af1 expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.539402:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:1.0:1788652332.539405:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788652332.539409:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c9400, rc 0) 00000100:00100000:1.0:1788652332.539569:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe49268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+59:11487:x1875537603667072:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 888us (1808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652332.539578:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 168 00000100:00100000:0.0:1788652332.545360:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652332.545465:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603667456 00000100:00100000:3.0:1788652332.545478:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603667456 00000100:00100000:3.0:1788652332.545551:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 48 00000100:00100000:3.0:1788652332.545563:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe49268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+59:11487:x1875537603667456:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:3.0:1788652332.546016:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe49268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+60:11487:x1875537603667456:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 453us (668us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788652332.546025:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 48 00000100:00100000:3.0:1788652332.550469:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652332.550611:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603667584 00000100:00100000:1.0:1788652332.550624:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603667584 00000100:00100000:1.0:1788652332.550759:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00100000:1.0:1788652332.550787:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+60:11487:x1875537603667584:12345-192.168.203.50@tcp:103:lfs.0 00010000:00010000:1.0:1788652332.550837:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788652332.550871:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9a00/0x340ed74ef02a808e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ad5 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.550906:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a80e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0aea expref: 59 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.550931:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9800/0x340ed74ef02a7f99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a96 expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.550943:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:1.0:1788652332.550956:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652332.551029:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+57:11487:x1875537603667584:12345-192.168.203.50@tcp:103:lfs.0 Request processed in 260us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652332.551038:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00100000:0.0:1788652332.554573:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652332.554685:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603667712 00000100:00100000:3.0:1788652332.554716:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603667712 00000100:00100000:3.0:1788652332.554835:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 169 00000100:00100000:3.0:1788652332.554848:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4926b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+57:11487:x1875537603667712:12345-192.168.203.50@tcp:58:lfs.0 00010000:00010000:3.0:1788652332.555176:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8105 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.555199:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8105 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.555214:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8105 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788652332.555492:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788652332.555609:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4926b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+57:11487:x1875537603667712:12345-192.168.203.50@tcp:58:lfs.0 Request processed in 761us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652332.555618:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 169 00000100:00100000:0.0:1788652332.580674:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652332.582360:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603667840 00000100:00100000:2.0:1788652332.582382:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603667840 00000100:00100000:2.0:1788652332.582752:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 170 00000100:00100000:2.0:1788652332.582766:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe49268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+57:11489:x1875537603667840:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1788652332.582843:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652332.582873:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a810c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0af8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.582997:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a8113 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583015:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a8113 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583028:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a8113 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583046:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a811a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583053:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a811a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583060:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a811a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583178:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a8121 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583187:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a8121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583194:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a8121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652332.583241:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788652332.583246:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788652332.583269:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a8121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583294:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a8121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583303:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a8113 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583310:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a8113 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583317:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a8113 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583323:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe40031a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652332.583338:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a8113 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583348:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a8113 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583361:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:2.0:1788652332.583365:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652332.583371:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a8113 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583376:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a8113 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583393:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a811a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583398:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a811a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583412:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a811a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583417:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe40031e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652332.583420:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a811a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583438:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a811a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583447:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cbe485ac500) 00010000:00010000:2.0:1788652332.583449:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652332.583452:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a811a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583458:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a811a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583496:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a810c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0af8 expref: 59 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583513:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a8121 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0af8 expref: 58 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.583521:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3600) 00010000:00010000:2.0:1788652332.583523:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788652332.583526:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe40031c00, rc 0) 00000100:00100000:2.0:1788652332.584671:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe49268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+58:11489:x1875537603667840:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 1899us (4004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652332.584695:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 170 00000100:00100000:3.0:1788652332.682452:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627783552:0@lo:400:kworker.0 00000100:00100000:3.0:1788652332.682544:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652332.682613:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788652332.682620:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627783680:0@lo:400:kworker.0 00000100:00100000:3.0:1788652332.682648:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652332.684301:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627783296:0@lo:400:kworker.0 00000100:00100000:1.0:1788652332.684391:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652332.684445:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627783808:0@lo:400:kworker.0 00000100:00100000:1.0:1788652332.684475:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652332.684507:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788652332.684515:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875537627783424:0@lo:400:kworker.0 00000100:00100000:1.0:1788652332.684541:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652332.684561:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627783936:0@lo:400:kworker.0 00000100:00100000:1.0:1788652332.684587:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652332.684630:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627783552 00000100:00100000:1.0:1788652332.684639:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627783552 00000100:00100000:1.0:1788652332.684719:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627783808 00000100:00100000:1.0:1788652332.684722:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627783808 00000100:00100000:1.0:1788652332.684992:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627783424 00000100:00100000:1.0:1788652332.684996:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627783424 00000100:00100000:1.0:1788652332.685017:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788652332.685026:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627783552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652332.685660:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627783296 00000100:00100000:3.0:1788652332.685665:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627783296 00000100:00100000:3.0:1788652332.685702:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788652332.685710:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:3305:x1875537627783296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652332.685795:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f811a652-691e-4a40-b660-977a4758dd08+19:3305:x1875537627783296:12345-0@lo:400:kworker.0 Request processed in 85us (1403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652332.685803:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788652332.685878:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788652332.685894:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627783808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652332.685927:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875537627783808:12345-0@lo:400:kworker.0 Request processed in 35us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652332.685934:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788652332.685951:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788652332.685957:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875537627783424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652332.685985:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875537627783424:12345-0@lo:400:kworker.0 Request processed in 29us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652332.685992:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1788652332.686035:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652332.686050:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627783680 00000100:00100000:3.0:1788652332.686055:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627783680 00000100:00100000:3.0:1788652332.686106:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627783936 00000100:00100000:3.0:1788652332.686110:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627783936 00000100:00100000:3.0:1788652332.686131:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788652332.686137:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627783680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652332.686178:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627783680:12345-0@lo:400:kworker.0 Request processed in 42us (3529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652332.686184:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788652332.686197:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788652332.686202:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b04df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1875537627783936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652332.686250:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b04df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1875537627783936:12345-0@lo:400:kworker.0 Request processed in 48us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652332.686256:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788652332.686303:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627783680:0@lo:400:kworker.0 00000100:00080000:3.0:1788652332.686353:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788652332.686356:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788652332.686414:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875537627783424:0@lo:400:kworker.0 00000100:00100000:3.0:1788652332.686426:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627783936:0@lo:400:kworker.0 00000100:00100000:3.0:1788652332.686435:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627783296:0@lo:400:kworker.0 00000100:00100000:3.0:1788652332.686444:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627783808:0@lo:400:kworker.0 00000100:00100000:1.0:1788652332.686577:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627783552:12345-0@lo:400:kworker.0 Request processed in 1551us (4031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652332.686584:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788652332.690760:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627783552:0@lo:400:kworker.0 00000100:00100000:2.0:1788652332.722257:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652332.722303:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652332.722345:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652332.722381:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652332.722412:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603668096 00000100:00100000:2.0:1788652332.722424:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603668096 00000100:00100000:2.0:1788652332.722498:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603668224 00000100:00100000:2.0:1788652332.722502:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603668224 00000100:00100000:2.0:1788652332.722531:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 87 00000100:00100000:2.0:1788652332.722544:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4924d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2348:x1875537603668096:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652332.723844:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4924d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2348:x1875537603668096:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 1293us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652332.724160:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 87 00000100:00100000:2.0:1788652332.724200:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 88 00000100:00100000:2.0:1788652332.724214:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4924dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2348:x1875537603668224:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652332.724269:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4924dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2348:x1875537603668224:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 60us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652332.724276:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 88 00000100:00100000:2.0:1788652332.724299:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603668352 00000100:00100000:2.0:1788652332.724307:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603668352 00000100:00100000:2.0:1788652332.724370:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 146 00000100:00100000:2.0:1788652332.724377:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4924d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2348:x1875537603668352:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652332.724408:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4924d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2348:x1875537603668352:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 32us (2106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652332.724433:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 146 00000100:00100000:2.0:1788652332.724455:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603667968 00000100:00100000:2.0:1788652332.724460:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603667968 00000100:00100000:2.0:1788652332.724489:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 294 00000100:00100000:2.0:1788652332.724496:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2348:x1875537603667968:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652332.724544:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2348:x1875537603667968:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 48us (2198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652332.724550:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 294 00000100:00080000:2.0:1788652332.724586:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788652332.724592:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788652332.724595:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788652332.747381:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788652332.747394:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788652332.747458:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788652332.747466:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788652332.747628:0:11670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe49268000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1875537627784064:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788652332.747756:0:11670:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4502c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652332.763823:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652332.764067:0:11670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe49268000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1875537627784064:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788652332.768215:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603668480 00000100:00100000:2.0:1788652332.768239:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603668480 00000100:00100000:2.0:1788652332.768313:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 171 00000100:00100000:2.0:1788652332.768337:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+58:11500:x1875537603668480:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788652332.768379:0:6701:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788652332.768529:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+58:11500:x1875537603668480:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 205us (4720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652332.768538:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 171 00000100:00100000:1.0:1788652332.776093:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652332.776713:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603668608 00000100:00100000:2.0:1788652332.776728:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603668608 00000100:00100000:2.0:1788652332.776829:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 172 00000100:00100000:2.0:1788652332.776842:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+58:11500:x1875537603668608:12345-192.168.203.50@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788652332.776954:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a8128 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.776997:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a8128 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777012:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a8128 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777033:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a812f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777040:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a812f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777048:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a812f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777082:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a8136 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777091:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a8136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777098:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a8136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652332.777147:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788652332.777152:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788652332.777168:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a8136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777182:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a8128 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777199:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a8128 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777206:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a8128 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777212:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe40031a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652332.777217:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a8128 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777226:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a8128 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777240:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbe7fde3200) 00010000:00010000:2.0:1788652332.777244:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652332.777250:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a8128 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777257:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031a00/0x340ed74ef02a8128 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777273:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a812f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777279:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a812f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777284:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a812f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777290:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe40031e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652332.777299:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a812f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777306:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a812f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777315:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8cbe485ac200) 00010000:00010000:2.0:1788652332.777317:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652332.777320:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a812f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777336:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031e00/0x340ed74ef02a812f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777353:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a8136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777358:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a8136 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777363:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a8136 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777368:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe40030e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652332.777371:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a8136 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777376:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a8136 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777383:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3600) 00010000:00010000:2.0:1788652332.777385:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652332.777395:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a8136 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.777401:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40030e00/0x340ed74ef02a8136 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652332.777497:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+58:11500:x1875537603668608:12345-192.168.203.50@tcp:34:lhsmtool_posix.0 Request processed in 656us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652332.777507:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 172 00000001:00080000:3.0:1788652332.784266:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1788652332.784291:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:2.0:1788652332.790177:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652332.790220:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603668864 00000100:00100000:2.0:1788652332.790233:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603668864 00000100:00100000:2.0:1788652332.790297:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 173 00000100:00100000:2.0:1788652332.790309:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4924ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+58:11500:x1875537603668864:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788652332.790344:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652332.790373:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a813d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0aff expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.790499:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8144 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.790518:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.790530:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652332.790542:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788652332.790830:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.790855:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8144 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.790862:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8144 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.790868:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215fa00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652332.790873:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8144 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.791338:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8144 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.791359:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3600) 00010000:00010000:2.0:1788652332.791362:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788652332.791369:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8144 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.791376:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8144 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.791435:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a813d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0aff expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.791448:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbe7fde3200) 00010000:00010000:2.0:1788652332.791450:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788652332.791453:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a813d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0aff expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.791465:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215e200, rc 0) 00000100:00100000:2.0:1788652332.791564:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4924ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+59:11500:x1875537603668864:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 1257us (1397us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1788652332.791575:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 173 00000100:00100000:3.0:1788652332.796279:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652332.796324:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603668992 00000100:00100000:3.0:1788652332.796348:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603668992 00000100:00100000:3.0:1788652332.796415:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 174 00000100:00100000:3.0:1788652332.796427:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+59:11500:x1875537603668992:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788652332.796476:0:5836:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788652332.796625:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+59:11500:x1875537603668992:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 199us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652332.796646:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 174 00000100:00100000:3.0:1788652332.802367:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652332.803490:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603669248 00000100:00100000:2.0:1788652332.803509:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603669248 00000100:00100000:2.0:1788652332.803582:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 175 00000100:00100000:2.0:1788652332.803594:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+59:11500:x1875537603669248:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788652332.803619:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652332.803623:0:11683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788652332.803657:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9400/0x340ed74ef02a80fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0af1 expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.803680:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:2.0:1788652332.803687:0:11683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788652332.803716:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a8152 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0b06 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788652332.809816:0:11683:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788652332.810249:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a8159 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.810271:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a8159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.810286:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a8159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.810391:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a8152 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b06 expref: 61 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.810432:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a8159 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b06 expref: 60 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.810443:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cbe485ac200) 00010000:00010000:2.0:1788652332.810447:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788652332.810451:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215f400, rc 0) 00000100:00100000:2.0:1788652332.810535:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+60:11500:x1875537603669248:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 6942us (8178us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788652332.810546:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 175 00000100:00100000:3.0:1788652332.825107:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652332.825152:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603669504 00000100:00100000:3.0:1788652332.825165:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603669504 00000100:00100000:3.0:1788652332.825238:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 176 00000100:00100000:3.0:1788652332.825249:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+60:11500:x1875537603669504:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788652332.825320:0:6701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652332.825368:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a8159 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b06 expref: 60 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.825390:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cbe485ac200) 00010000:00010000:3.0:1788652332.825411:0:6701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788652332.825444:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8167 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.825461:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8167 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.825473:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8167 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.830696:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a816e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x4956a8ba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.830724:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a816e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4956a8ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.830738:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a816e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4956a8ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.830969:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8167 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.830978:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8167 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.830997:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8167 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.831005:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652332.831010:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8167 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.831019:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8167 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.831033:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:3.0:1788652332.831036:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652332.831040:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8167 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.831047:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8167 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.831060:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a816e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4956a8ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.831067:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a816e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4956a8ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.831072:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a816e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4956a8ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.831077:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652332.831080:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a816e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4956a8ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.831097:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a816e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4956a8ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.831109:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x4956a8ba (ffff8cbe7fde3f00) 00010000:00010000:3.0:1788652332.831112:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652332.831116:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a816e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x4956a8ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.831122:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a816e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x4956a8ba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652332.831234:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+59:11500:x1875537603669504:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 5982us (6136us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788652332.831244:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 176 00000100:00100000:3.0:1788652332.838222:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652332.838292:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603669632 00000100:00100000:0.0:1788652332.838310:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603669632 00000100:00100000:0.0:1788652332.838426:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 177 00000100:00100000:0.0:1788652332.838439:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+59:11500:x1875537603669632:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788652332.838468:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652332.838499:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8175 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0b0d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652332.838552:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a817c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652332.838570:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a817c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652332.838585:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a817c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652332.842512:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8175 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b0d expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652332.842552:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a817c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b0d expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652332.842573:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cbe48888200) 00010000:00010000:0.0:1788652332.842576:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788652332.842581:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e57a00, rc 0) 00000100:00100000:0.0:1788652332.842689:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+60:11500:x1875537603669632:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 4248us (4473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652332.842701:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 177 00000001:00080000:0.0:1788652332.845113:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967445 is committed 00000001:00080000:0.0:1788652332.845140:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000001:00080000:0.0:1788652332.845174:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967455 is committed 00000004:00080000:0.0:1788652332.845195:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788652332.845220:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cbe4953f6c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1788652332.845226:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbe49cbed00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cbe4953f3c0 00000020:00080000:0.0:1788652332.845229:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbe81bff000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cbe7f1c7800 00000001:00080000:0.0:1788652332.845261:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000020:00080000:2.0:1788652332.845322:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788652332.845547:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788652332.846144:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788652332.846173:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627784192:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788652332.846260:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652332.846489:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627784192 00000100:00100000:3.0:1788652332.846500:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627784192 00000100:00100000:3.0:1788652332.846596:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788652332.846608:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4924e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627784192:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788652332.846742:0:8297:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1788652332.846813:0:8297:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9cab29, atime: 0x6a9cab29, ctime: 0x6a9cab29, blocks: 0xb 00010000:00010000:3.0:1788652332.846823:0:8297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8a74613/0x340ed74ef02a8183 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.846843:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=349s v=(0 0) 00010000:00010000:3.0:1788652332.846848:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652332.846855:0:8297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8a74613/0x340ed74ef02a8183 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.846894:0:8297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8a74613/0x340ed74ef02a8183 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.846906:0:8297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8a74613/0x340ed74ef02a8183 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.846913:0:8297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8a74613/0x340ed74ef02a8183 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.846935:0:8297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788652332.847589:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4924e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1875537627784192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 979us (1324us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788652332.847600:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788652332.847915:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652332.847951:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603669888 00000100:00100000:0.0:1788652332.847958:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603669888 00000100:00100000:0.0:1788652332.848004:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 178 00000100:00100000:0.0:1788652332.848014:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe49269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+18:11500:x1875537603669888:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788652332.848106:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a818a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652332.848124:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a818a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652332.848134:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a818a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788652332.848485:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1788652332.848497:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 349831724553ns, next at 350831722216ns, rc = 0 00000004:00010000:0.0:1788652332.848599:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d80188b reply state 0000000097d6934c transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a818a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652332.848609:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788652332.848707:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe49269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+20:11500:x1875537603669888:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 692us (793us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1788652332.848715:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 178 00010000:00010000:3.0:1788652332.855717:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652332.855736:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8a74613/0x340ed74ef02a8183 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.855753:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4200 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:3.0:1788652332.855760:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8a74613/0x340ed74ef02a8183 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.855799:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8a74613/0x340ed74ef02a8183 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.855829:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8a74613/0x340ed74ef02a8183 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.855846:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8a74613/0x340ed74ef02a8183 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.855873:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652332.855875:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652332.855876:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652332.855934:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1788652332.855941:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1788652332.855976:0:3304:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cbe7f2bed80 x1875537627784192/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788652348 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788652332.855990:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cbe7f2bed80/2, rc 0, transno 4294967307 00000100:00100000:3.0:1788652332.855996:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627784192:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788652332.861155:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00010000:00010000:3.0:1788652332.861196:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a818a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.861211:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a818a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.861220:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a818a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.861227:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e56400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652332.861234:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a818a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.861243:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a818a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.861285:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cbe48888200) 00010000:00010000:3.0:1788652332.861289:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788652332.861295:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a818a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.861302:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a818a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652332.861353:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603670016 00000100:00100000:3.0:1788652332.861365:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603670016 00000100:00100000:3.0:1788652332.861424:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 179 00000100:00100000:3.0:1788652332.861436:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+19:11500:x1875537603670016:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788652332.861475:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652332.861556:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8191 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0b14 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.861637:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8191 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b14 expref: 20 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.861652:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8191 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b14 expref: 20 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.861676:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cbe48888200) 00010000:00010000:3.0:1788652332.861679:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788652332.861682:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e4a00, rc 0) 00000100:00100000:3.0:1788652332.861753:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+20:11500:x1875537603670016:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 319us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652332.861798:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 179 00000100:00100000:3.0:1788652332.865860:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652332.865923:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603670144 00000100:00100000:3.0:1788652332.865933:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603670144 00000100:00100000:3.0:1788652332.865992:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 51 00000100:00100000:3.0:1788652332.866004:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2347:x1875537603670144:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788652332.866381:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2347:x1875537603670144:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 Request processed in 378us (532us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788652332.866389:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 51 00000100:00100000:0.0:1788652332.880673:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652332.880751:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603670400 00000100:00100000:3.0:1788652332.880762:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603670400 00000100:00100000:3.0:1788652332.880858:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00100000:3.0:1788652332.880870:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4926a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+20:11500:x1875537603670400:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788652332.881113:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4926a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+21:11500:x1875537603670400:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 246us (449us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788652332.881121:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00100000:3.0:1788652332.884693:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652332.884821:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603670656 00000100:00100000:0.0:1788652332.884830:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603670656 00000100:00100000:0.0:1788652332.884887:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 180 00000100:00100000:0.0:1788652332.884898:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+21:11500:x1875537603670656:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788652332.885026:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+21:11500:x1875537603670656:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 130us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652332.885034:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 180 00000100:00100000:0.0:1788652332.892617:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652332.892919:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603670784 00000100:00100000:1.0:1788652332.892938:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603670784 00000100:00100000:1.0:1788652332.893029:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 181 00000100:00100000:1.0:1788652332.893043:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4926b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+21:11500:x1875537603670784:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788652332.893071:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652332.893099:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a8198 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0b1b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.893291:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a819f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.893310:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a819f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.893324:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a819f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652332.893381:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788652332.893404:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a819f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.894629:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9e00/0x340ed74ef02a8198 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b1b expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.894658:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a819f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b1b expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.894689:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cbe48888200) 00010000:00010000:1.0:1788652332.894693:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788652332.894698:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c8400, rc 0) 00000100:00100000:1.0:1788652332.894804:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4926b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+22:11500:x1875537603670784:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 1760us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652332.894814:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 181 00000100:00100000:3.0:1788652332.899704:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652332.899803:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603670912 00000100:00100000:2.0:1788652332.899812:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603670912 00000100:00100000:2.0:1788652332.899864:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 52 00000100:00100000:2.0:1788652332.899873:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2346:x1875537603670912:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788652332.899898:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652332.899920:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025837c25/0x340ed74ef02a81a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0b22 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788652332.899946:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cab2b, blocks: 0x1 00010000:00010000:2.0:1788652332.899966:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=349s v=(0 0) 00010000:00010000:2.0:1788652332.899970:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652332.899986:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025837c25/0x340ed74ef02a81a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b22 expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.900005:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000025837c25/0x340ed74ef02a81a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b22 expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.900019:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215e400, rc 0) 00000100:00100000:2.0:1788652332.900077:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2346:x1875537603670912:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 205us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652332.900084:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 52 00000100:00100000:3.0:1788652332.904507:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652332.904575:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603671168 00000100:00100000:2.0:1788652332.904583:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603671168 00000100:00100000:2.0:1788652332.904637:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 182 00000100:00100000:2.0:1788652332.904646:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+22:11500:x1875537603671168:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788652332.904735:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+22:11500:x1875537603671168:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 90us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652332.904742:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 182 00000100:00100000:0.0:1788652332.913722:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652332.913806:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603671296 00000100:00100000:3.0:1788652332.913817:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603671296 00000100:00100000:3.0:1788652332.913874:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 53 00000100:00100000:3.0:1788652332.913892:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4926ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:11500:x1875537603671296:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788652332.913909:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652332.913939:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a67f9b81/0x340ed74ef02a81ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0b29 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.913971:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000025837c25/0x340ed74ef02a81a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b22 expref: 9 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.913981:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652332.913985:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652332.913991:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a67f9b81/0x340ed74ef02a81ad lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b29 expref: 9 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.914029:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000025837c25/0x340ed74ef02a81a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b22 expref: 9 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652332.914044:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000025837c25/0x340ed74ef02a81a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b22 expref: 9 pid: 6679 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652332.914057:0:6678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6678:1875537627784320:192.168.203.50@tcp:104: 00000100:00100000:3.0:1788652332.914143:0:6678:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4a32c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652332.931716:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652332.931839:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603671424 00000100:00100000:1.0:1788652332.931849:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603671424 00010000:00010000:1.0:1788652332.932039:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000025837c25/0x340ed74ef02a81a6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b22 expref: 10 pid: 6679 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652332.932083:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 67 00000100:00100000:1.0:1788652332.932094:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a284700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+10:2347:x1875537603671424:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652332.932110:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652332.932132:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000025837c25/0x340ed74ef02a81a6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b22 expref: 10 pid: 6679 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.932145:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000025837c25/0x340ed74ef02a81a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b22 expref: 10 pid: 6679 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.932169:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652332.932174:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652332.932182:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a67f9b81/0x340ed74ef02a81ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b29 expref: 10 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.932214:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a67f9b81/0x340ed74ef02a81ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b29 expref: 10 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652332.932369:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a67f9b81/0x340ed74ef02a81ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b29 expref: 10 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652332.932384:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a219f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5822:1875537627784448:192.168.203.50@tcp:105: 00000100:00100000:1.0:1788652332.932471:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe49d3cc00 going to sleep for 11 seconds 00010000:00010000:2.0:1788652332.933067:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025837c25/0x340ed74ef02a81a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b22 expref: 10 pid: 6679 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652332.933098:0:6678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6678:1875537627784320:192.168.203.50@tcp:104: 00010000:00010000:2.0:1788652332.933125:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a67f9b81/0x340ed74ef02a81ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b29 expref: 9 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652332.933136:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5c00, rc 0) 00000100:00100000:2.0:1788652332.933243:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4926ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:11500:x1875537603671296:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 19349us (19517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652332.933252:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 53 00000100:00100000:1.0:1788652332.938509:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a219f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5822:1875537627784448:192.168.203.50@tcp:105: 00010000:00010000:1.0:1788652332.938538:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652332.938641:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a284700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2347:x1875537603671424:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 6549us (6934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652332.938652:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 67 00000100:00100000:3.0:1788652332.946115:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652332.946280:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603671552 00000100:00100000:1.0:1788652332.946290:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603671552 00002000:00100000:1.0:1788652332.946348:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8cbe7f8d0e00 x1875537603671552/t0(0) o4->20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp:718/0 lens 504/0 e 0 to 0 dl 1788652343 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788652332.946360:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe7f8d0e00 with x1875537603671552 ext(0->8) 00002000:00010000:1.0:1788652332.946366:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbe7f8d0e00 00000100:00100000:1.0:1788652332.946409:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:1.0:1788652332.946419:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2349:x1875537603671552:12345-192.168.203.50@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788652332.946951:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+10:2349:x1875537603671552:12345-192.168.203.50@tcp:4:lhsmtool_posix.0 Request processed in 530us (843us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788652332.946968:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 4 00002000:00100000:1.0:1788652332.946976:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8cbe7f8d0e00 x1875537603671552/t4294967314(0) o4->20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp:718/0 lens 504/448 e 0 to 0 dl 1788652343 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788652332.946984:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe7f8d0e00 with x1875537603671552 ext(0->8) 00002000:00010000:1.0:1788652332.946988:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbe7f8d0e00 00000100:00100000:0.0:1788652332.950741:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652332.950890:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603671680 00000100:00100000:1.0:1788652332.950900:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603671680 00000100:00100000:1.0:1788652332.950959:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 183 00000100:00100000:1.0:1788652332.950969:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4926b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+22:11500:x1875537603671680:12345-192.168.203.50@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788652333.006975:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:2.0:1788652333.006987:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1788652333.007012:0:5857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:2.0:1788652333.007027:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:2.0:1788652333.007147:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1788652333.007160:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788652333.007179:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4924c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627784576:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788652333.007261:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652333.007347:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627784576 00000100:00100000:2.0:1788652333.007355:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627784576 00000100:00100000:2.0:1788652333.007399:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788652333.007407:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4924c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627784576:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788652333.007541:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788652333.007545:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788652331 00002000:00010000:2.0:1788652333.007547:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788652333.007549:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788652331 -> 1788652331 00002000:00010000:2.0:1788652333.007552:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788652333.007590:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4924c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875537627784576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 183us (341us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788652333.007598:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:2.0:1788652333.007637:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cbe4924c700/2, rc 0, transno 4294967315 00000100:00100000:2.0:1788652333.007642:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4924c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627784576:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788652333.008458:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4926b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+18:11500:x1875537603671680:12345-192.168.203.50@tcp:44:lhsmtool_posix.0 Request processed in 57485us (57722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652333.008468:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 183 00000100:00100000:3.0:1788652333.020369:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652333.020637:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603671808 00000100:00100000:0.0:1788652333.020648:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603671808 00000100:00100000:0.0:1788652333.020708:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 55 00000100:00100000:0.0:1788652333.020719:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+10:2349:x1875537603671808:12345-192.168.203.50@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788652333.070250:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:0.0:1788652333.070538:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2349:x1875537603671808:12345-192.168.203.50@tcp:16:lhsmtool_posix.0 Request processed in 49815us (50173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652333.070560:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 55 00000001:00080000:1.0:1788652333.071112:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1788652333.083488:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652333.083895:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603672064 00000100:00100000:3.0:1788652333.083905:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603672064 00000100:00100000:3.0:1788652333.083978:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 184 00000100:00100000:3.0:1788652333.083989:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe49269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+18:11500:x1875537603672064:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788652333.084055:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652333.084083:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a819f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b1b expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.084101:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cbe48888200) 00010000:00010000:3.0:1788652333.084107:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788652333.084138:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a81b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.084152:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a81b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.084162:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a81b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788652333.084430:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004429dc84 reply state 0000000019c2f48d transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a81b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652333.084439:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788652333.084531:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe49269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+19:11500:x1875537603672064:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 543us (1051us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788652333.084539:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 184 00000100:00100000:0.0:1788652333.091155:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652333.091353:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603672192 00000100:00100000:1.0:1788652333.091362:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603672192 00000100:00100000:1.0:1788652333.091413:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 56 00000100:00100000:1.0:1788652333.091423:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4926bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2348:x1875537603672192:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788652333.091653:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788652333.091656:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788652331 -> 1788652330 00002000:00010000:1.0:1788652333.091659:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788652329 00002000:00010000:1.0:1788652333.091660:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788652331 -> 1788652330 00002000:00010000:1.0:1788652333.091663:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788652333.091717:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4926bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2348:x1875537603672192:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 Request processed in 295us (570us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788652333.091733:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 56 00010000:00010000:2.0:1788652333.093359:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a81b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.093391:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a81b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.093397:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a81b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.093403:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652333.093407:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a81b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.093415:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a81b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.093430:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cbe48888200) 00010000:00010000:2.0:1788652333.093433:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652333.093438:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a81b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.093444:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a81b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652333.106659:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652333.106750:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603672448 00000100:00100000:1.0:1788652333.106759:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603672448 00000100:00100000:1.0:1788652333.106836:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 185 00000100:00100000:1.0:1788652333.106846:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+18:11500:x1875537603672448:12345-192.168.203.50@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788652333.106926:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a81bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.106943:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a817c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b0d expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.106953:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a81bb lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.106990:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a817c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b0d expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.107005:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a817c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b0d expref: 18 pid: 5837 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652333.107019:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a219f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875537627784704:192.168.203.50@tcp:104: 00000100:00100000:1.0:1788652333.107119:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe49d3c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788652333.112744:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652333.112798:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603672576 00000100:00100000:1.0:1788652333.112807:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603672576 00010000:00010000:1.0:1788652333.112845:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a817c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b0d expref: 19 pid: 5837 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652333.112907:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a219f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875537627784704:192.168.203.50@tcp:104: 00000100:00100000:1.0:1788652333.112913:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 68 00000100:00100000:1.0:1788652333.112921:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe494adc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+19:2346:x1875537603672576:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652333.112931:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a81bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.112935:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652333.112942:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a817c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b0d expref: 19 pid: 5837 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.112954:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a817c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b0d expref: 19 pid: 5837 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.112977:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a817c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b0d expref: 19 pid: 5837 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.112989:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cbe48888200) 00010000:00010000:1.0:1788652333.112993:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a81bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.113000:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a81bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.113006:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a81bb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.113026:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652333.113073:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe494adc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+18:2346:x1875537603672576:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 153us (336us total) trans 0 rc 0/0 00010000:00010000:3.0:1788652333.113088:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a81bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652333.113092:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 68 00010000:00010000:3.0:1788652333.113105:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a81bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.113134:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a81bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.113141:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a81bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.113148:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a81bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.113154:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c8800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652333.113158:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a81bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.113166:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a81bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.113175:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cbe48888200) 00010000:00010000:3.0:1788652333.113177:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788652333.113181:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a81bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.113186:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a81bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652333.113363:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+17:11500:x1875537603672448:12345-192.168.203.50@tcp:55:lhsmtool_posix.0 Request processed in 6463us (6659us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788652333.113375:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 185 00000100:00100000:1.0:1788652333.119606:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652333.119682:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603672704 00000100:00100000:3.0:1788652333.119692:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603672704 00000100:00100000:3.0:1788652333.119825:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00100000:3.0:1788652333.119834:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2348:x1875537603672704:12345-192.168.203.50@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788652333.119895:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a81c2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.119914:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a67f9b81/0x340ed74ef02a81ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b29 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.119922:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788652333.119927:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788652333.119932:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a81c2 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.119965:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a67f9b81/0x340ed74ef02a81ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b29 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.119980:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a67f9b81/0x340ed74ef02a81ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b29 expref: 8 pid: 6678 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652333.119993:0:6678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f8d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6678:1875537627784832:192.168.203.50@tcp:104: 00000100:00100000:3.0:1788652333.120064:0:6678:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe473a9900 going to sleep for 11 seconds 00000100:00100000:0.0:1788652333.129969:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652333.130452:0:6678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f8d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6678:1875537627784832:192.168.203.50@tcp:104: 00010000:00010000:2.0:1788652333.130481:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a81c2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652333.130888:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603672832 00000100:00100000:2.0:1788652333.130896:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603672832 00010000:00010000:2.0:1788652333.130932:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a67f9b81/0x340ed74ef02a81ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b29 expref: 9 pid: 6678 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652333.130996:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 69 00000100:00100000:2.0:1788652333.131006:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4926aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:2347:x1875537603672832:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652333.131021:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652333.131043:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a67f9b81/0x340ed74ef02a81ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b29 expref: 9 pid: 6678 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.131057:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a67f9b81/0x340ed74ef02a81ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b29 expref: 9 pid: 6678 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.131232:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a67f9b81/0x340ed74ef02a81ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b29 expref: 9 pid: 6678 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.131247:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788652333.131252:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788652333.131258:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a81c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.131269:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a81c2 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.131339:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652333.131394:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4926aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2347:x1875537603672832:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 389us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652333.131402:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 69 00010000:00010000:3.0:1788652333.132570:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a81c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.132583:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a81c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.132622:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a81c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.132631:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a81c2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.132639:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a81c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.132646:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5400 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:3.0:1788652333.132650:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a81c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.132660:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a81c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.132677:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a81c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.132685:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a81c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652333.137041:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2348:x1875537603672704:12345-192.168.203.50@tcp:1:lhsmtool_posix.0 Request processed in 17199us (17435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652333.137055:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00100000:0.0:1788652333.144723:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652333.146005:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603673088 00000100:00100000:2.0:1788652333.146018:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603673088 00000100:00100000:2.0:1788652333.146125:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 186 00000100:00100000:2.0:1788652333.146136:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe49269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+17:11500:x1875537603673088:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788652333.146216:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a81c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.146235:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a81c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.146247:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a81c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.146465:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a81d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.146478:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8191 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b14 expref: 18 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.146487:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a81d0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.146519:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8191 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b14 expref: 18 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.146533:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8191 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b14 expref: 18 pid: 6701 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652333.146564:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4924f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875537627784960:192.168.203.50@tcp:104: 00000100:00100000:2.0:1788652333.146649:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb780 going to sleep for 11 seconds 00000100:00100000:1.0:1788652333.156894:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652333.156930:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603673216 00000100:00100000:1.0:1788652333.156938:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603673216 00010000:00010000:1.0:1788652333.156975:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8191 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b14 expref: 19 pid: 6701 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652333.157010:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 70 00000100:00100000:1.0:1788652333.157026:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+19:2346:x1875537603673216:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652333.157041:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652333.157049:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8191 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b14 expref: 19 pid: 6701 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.157064:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8191 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b14 expref: 19 pid: 6701 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.157087:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cbe48888200) 00010000:00010000:1.0:1788652333.157093:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a81d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.157103:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a81d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.157110:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a81d0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.157129:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652333.157179:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+19:2346:x1875537603673216:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 154us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652333.157188:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 70 00010000:00010000:1.0:1788652333.157306:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8191 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b14 expref: 18 pid: 6701 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652333.157320:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4924f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875537627784960:192.168.203.50@tcp:104: 00010000:00010000:1.0:1788652333.157352:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a81d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.157361:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a81d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.157366:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a81d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788652333.157550:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1788652333.157723:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1788652333.157809:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1788652333.157891:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a404000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5835:1875537627785088:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788652333.157937:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652333.157967:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4e8b8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652333.157986:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627785088 00000100:00100000:1.0:1788652333.157992:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627785088 00000100:00100000:1.0:1788652333.158024:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788652333.158033:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f87d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1875537627785088:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788652333.158098:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f87d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1875537627785088:12345-0@lo:1000:mdt00_000.0 Request processed in 66us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652333.158104:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788652333.158155:0:5835:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1788652333.158160:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cbe4924c700, transno 4294967315 00000100:00100000:1.0:1788652333.158180:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a404000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5835:1875537627785088:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788652333.158689:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1788652333.158746:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f87e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5835:1875537627785216:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788652333.158799:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652333.158821:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe49d3cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788652333.158839:0:12399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627785216 00000100:00100000:1.0:1788652333.158842:0:12399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627785216 00000100:00100000:1.0:1788652333.158873:0:12399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788652333.158881:0:12399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f87c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5835:x1875537627785216:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788652333.159055:0:12399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f87c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5835:x1875537627785216:12345-0@lo:1000:mdt00_000.0 Request processed in 173us (253us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788652333.159068:0:12399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788652333.159108:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f87e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5835:1875537627785216:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788652333.159136:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a81d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.159144:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a81d0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.159151:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a81d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.159157:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652333.159162:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a81d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.159170:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a81d0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.159184:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cbe48888200) 00010000:00010000:1.0:1788652333.159194:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788652333.159201:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a81d0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.159208:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a81d0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.159239:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8105 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.159246:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8105 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.159252:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8105 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.159257:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652333.159260:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8105 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.159265:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8105 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.159273:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3600) 00010000:00010000:1.0:1788652333.159276:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788652333.159279:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8105 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.159284:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8105 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.159307:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a81d7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.159342:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a8121 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0af8 expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.159351:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a81d7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.159375:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a8121 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0af8 expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.159390:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a8121 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0af8 expref: 21 pid: 5836 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652333.159402:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f87f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875537627785344:192.168.203.50@tcp:104: 00000100:00100000:1.0:1788652333.159471:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe492a6600 going to sleep for 11 seconds 00000100:00100000:1.0:1788652333.167065:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652333.167096:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603673344 00000100:00100000:1.0:1788652333.167104:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603673344 00010000:00010000:1.0:1788652333.167146:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a8121 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0af8 expref: 22 pid: 5836 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652333.167179:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 71 00000100:00100000:1.0:1788652333.167189:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a404000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+22:2346:x1875537603673344:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652333.167203:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652333.167209:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a8121 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0af8 expref: 22 pid: 5836 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.167236:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a8121 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0af8 expref: 22 pid: 5836 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.167258:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3600) 00010000:00010000:1.0:1788652333.167264:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a81d7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.167273:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a81d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.167280:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a81d7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.167297:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652333.167358:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a404000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+22:2346:x1875537603673344:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 170us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652333.167365:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 71 00010000:00010000:3.0:1788652333.167923:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe40031c00/0x340ed74ef02a8121 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0af8 expref: 21 pid: 5836 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652333.167952:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f87f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875537627785344:192.168.203.50@tcp:104: 00010000:00010000:3.0:1788652333.167976:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a81d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.167986:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a81d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.167992:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a81d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.168004:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a81d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.168010:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a81d7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.168016:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a81d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.168021:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652333.168026:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a81d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.168033:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a81d7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.168043:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3600) 00010000:00010000:3.0:1788652333.168045:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652333.168049:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a81d7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.168065:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a81d7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.168076:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a81c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.168082:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a81c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.168087:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a81c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.168092:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215fa00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652333.168094:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a81c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.168100:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a81c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.168107:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3600) 00010000:00010000:3.0:1788652333.168109:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788652333.168112:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a81c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.168118:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a81c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652333.168345:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe49269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+20:11500:x1875537603673088:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 22211us (23630us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1788652333.168354:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 186 00000020:00080000:3.0:1788652333.168363:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788652333.168532:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788652333.168537:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788652333.169033:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788652333.169042:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788652333.173232:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652333.174563:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603673600 00000100:00100000:1.0:1788652333.174576:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603673600 00000100:00100000:1.0:1788652333.174649:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 50 00000100:00100000:1.0:1788652333.174660:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe47b4ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+20:11500:x1875537603673600:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788652333.175628:0:5838:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788652333.176015:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1788652333.176070:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a81de lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.176087:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a81de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.176111:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a81de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.176121:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a81de lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.176128:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a81de lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.176134:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a81de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.176159:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788652333.176258:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe47b4ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+22:11500:x1875537603673600:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 1596us (3031us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788652333.176268:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 50 00000020:00080000:1.0:1788652333.176273:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788652333.176612:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652333.176620:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a81de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.176626:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c8400 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:3.0:1788652333.176630:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a81de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.176638:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a81de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.176651:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cbe48da0400) 00010000:00010000:3.0:1788652333.176653:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788652333.176658:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a81de lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.176664:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a81de lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.176680:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652333.176682:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652333.176683:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652333.193040:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788652333.193066:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4924c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627785472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788652333.193142:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652333.195743:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627785472 00000100:00100000:2.0:1788652333.195759:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627785472 00000100:00100000:2.0:1788652333.195905:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788652333.195915:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875537627785472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788652333.195951:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788652333.196678:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875537627785472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 762us (3533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652333.196688:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788652333.197352:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4924c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627785472:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788652333.321074:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788652333.445897:0:12443:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788652333.445907:0:12443:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788652333.445946:0:12443:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788652333.445954:0:12443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788652333.578453:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652333.578524:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603673856 00000100:00100000:3.0:1788652333.578534:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603673856 00000100:00100000:3.0:1788652333.578595:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 187 00000100:00100000:3.0:1788652333.578606:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+22:11510:x1875537603673856:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1788652333.578630:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652333.578764:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a81e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0b30 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.578888:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a81ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.578902:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a81ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.578914:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a81ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652333.578925:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788652333.579045:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a81e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b30 expref: 25 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.579063:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a81ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b30 expref: 24 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.579071:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:3.0:1788652333.579074:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788652333.579077:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5200, rc 0) 00000100:00100000:3.0:1788652333.579144:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+24:11510:x1875537603673856:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 539us (700us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788652333.579151:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 187 00000100:00100000:2.0:1788652333.583251:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652333.583339:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603673984 00000100:00100000:3.0:1788652333.583348:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603673984 00000100:00100000:3.0:1788652333.583406:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 188 00000100:00100000:3.0:1788652333.583416:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4924ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+24:11510:x1875537603673984:12345-192.168.203.50@tcp:34:lfs.0 00010000:00010000:3.0:1788652333.583506:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a81fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.583523:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a81fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.583534:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a81fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.583549:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8201 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.583556:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8201 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.583562:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8201 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.583926:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8208 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.583936:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.583944:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788652333.583985:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.583998:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a81fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.584015:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a81fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.584021:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a81fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.584027:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652333.584031:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a81fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.584039:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a81fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.584051:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:3.0:1788652333.584054:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652333.584058:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a81fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.584065:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a81fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.584074:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8201 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.584080:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8201 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.584086:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8201 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.584091:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652333.584099:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8201 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.584105:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8201 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.584113:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cbe7fde3600) 00010000:00010000:3.0:1788652333.584115:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652333.584118:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8201 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.584124:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8201 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.584137:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.584143:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8208 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.584149:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8208 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.584154:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652333.584156:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8208 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.584161:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8208 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.584168:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:3.0:1788652333.584170:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652333.584177:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8208 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.584183:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8208 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652333.584262:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4924ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+24:11510:x1875537603673984:12345-192.168.203.50@tcp:34:lfs.0 Request processed in 847us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652333.584272:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 188 00000100:00100000:1.0:1788652333.644670:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652333.644751:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603674240 00000100:00100000:3.0:1788652333.644761:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603674240 00000100:00100000:3.0:1788652333.644844:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 189 00000100:00100000:3.0:1788652333.644855:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+24:11513:x1875537603674240:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1788652333.644873:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652333.644907:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a820f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0b37 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.644978:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8216 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.644992:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8216 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.645004:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8216 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.645019:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a821d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.645026:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a821d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.645051:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a821d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.645306:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a8224 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.645315:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a8224 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.645333:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a8224 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652333.645342:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788652333.645427:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8216 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.645434:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8216 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.645440:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8216 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.645445:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652333.645450:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8216 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.645457:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8216 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.645467:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:3.0:1788652333.645470:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652333.645481:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8216 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.645489:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8216 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.645501:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a821d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.645507:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a821d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.645513:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a821d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.645519:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652333.645522:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a821d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.645527:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a821d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.645536:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cbe7fde3300) 00010000:00010000:3.0:1788652333.645538:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652333.645541:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a821d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.645547:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a821d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.645588:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a820f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b37 expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.645613:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a8224 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b37 expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.645621:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3600) 00010000:00010000:3.0:1788652333.645624:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788652333.645626:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5400, rc 0) 00000100:00100000:3.0:1788652333.645691:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+26:11513:x1875537603674240:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 837us (1030us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788652333.645699:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 189 00000100:00100000:0.0:1788652333.657178:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652333.657308:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603674368 00000100:00100000:3.0:1788652333.657318:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603674368 00000100:00100000:3.0:1788652333.657387:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 190 00000100:00100000:3.0:1788652333.657397:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe49269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+26:11513:x1875537603674368:12345-192.168.203.50@tcp:54:lfs.0 00010000:00010000:3.0:1788652333.657461:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8232 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.657476:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.657487:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.657511:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8232 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.657517:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8232 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.657540:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8232 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.657546:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652333.657550:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8232 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.657558:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8232 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.657570:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3600) 00010000:00010000:3.0:1788652333.657573:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788652333.657578:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8232 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.657584:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8232 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652333.657650:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe49269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+26:11513:x1875537603674368:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 255us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652333.657657:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 190 00000100:00100000:0.0:1788652333.659812:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652333.659948:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603674624 00000100:00100000:1.0:1788652333.659956:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603674624 00000100:00100000:1.0:1788652333.660006:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 51 00000100:00100000:1.0:1788652333.660014:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe49269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+26:11513:x1875537603674624:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:1.0:1788652333.660224:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe49269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+27:11513:x1875537603674624:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 209us (458us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788652333.660242:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 51 00000100:00100000:1.0:1788652333.727474:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652333.727670:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603674880 00000100:00100000:3.0:1788652333.727680:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603674880 00000100:00100000:3.0:1788652333.727906:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 191 00000100:00100000:3.0:1788652333.727918:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+27:11046:x1875537603674880:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:3.0:1788652333.727953:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652333.727974:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8239 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0b3e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.728120:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8240 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.728135:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a8224 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b37 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.728144:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8240 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.728177:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a8224 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b37 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.728191:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a8224 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b37 expref: 28 pid: 5835 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652333.728205:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f8d3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875537627785600:192.168.203.50@tcp:104: 00000100:00100000:3.0:1788652333.728301:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe473a9540 going to sleep for 11 seconds 00000100:00100000:3.0:1788652333.732201:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f8d3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5837:1875537627785600:192.168.203.50@tcp:104: 00010000:00010000:3.0:1788652333.732229:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8240 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652333.733123:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652333.733314:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603675008 00000100:00100000:2.0:1788652333.733334:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603675008 00010000:00010000:2.0:1788652333.733375:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a8224 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b37 expref: 29 pid: 5835 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652333.733417:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 72 00000100:00100000:2.0:1788652333.733426:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f16df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+29:2346:x1875537603675008:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652333.733441:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652333.733448:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a8224 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b37 expref: 29 pid: 5835 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.733461:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a8224 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b37 expref: 29 pid: 5835 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.733501:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a8224 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b37 expref: 29 pid: 5835 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.733516:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3600) 00010000:00010000:2.0:1788652333.733521:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8240 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.733530:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8240 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.733537:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8240 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.733570:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652333.733635:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f16df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+28:2346:x1875537603675008:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 211us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652333.733642:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 72 00010000:00010000:0.0:1788652333.734139:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8240 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.734149:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8240 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652333.734167:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788652333.734308:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8239 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b3e expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.734337:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8240 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b3e expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.734359:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3600) 00010000:00010000:0.0:1788652333.734362:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788652333.734365:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e4a00, rc 0) 00000100:00100000:0.0:1788652333.734410:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+28:11046:x1875537603674880:12345-192.168.203.50@tcp:101:bash.0 Request processed in 6494us (6944us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788652333.734419:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 191 00000100:00100000:1.0:1788652333.739015:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652333.739111:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603675264 00000100:00100000:3.0:1788652333.739122:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603675264 00000100:00100000:3.0:1788652333.739182:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 192 00000100:00100000:3.0:1788652333.739193:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+28:11046:x1875537603675264:12345-192.168.203.50@tcp:36:bash.0 00010000:00010000:3.0:1788652333.739458:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a824e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.739487:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a824e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.739500:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a824e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788652333.739557:0:6701:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1788652333.739588:0:6701:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d19510d8 reply state 00000000903d6dcc transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a824e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652333.739598:0:6701:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788652333.739957:0:6701:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1788652333.740110:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+32:11046:x1875537603675264:12345-192.168.203.50@tcp:36:bash.0 Request processed in 917us (1101us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1788652333.740117:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 192 00000020:00080000:3.0:1788652333.740122:0:6701:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788652333.742446:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a824e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.742461:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a824e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.742469:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a824e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.742475:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652333.742479:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a824e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.742487:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a824e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.742520:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3600) 00010000:00010000:3.0:1788652333.742523:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652333.742529:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a824e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.742534:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a824e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652333.743205:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652333.743277:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603675392 00000100:00100000:3.0:1788652333.743286:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603675392 00000100:00100000:3.0:1788652333.743380:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 193 00000100:00100000:3.0:1788652333.743390:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+31:11046:x1875537603675392:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:3.0:1788652333.743412:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652333.743429:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8255 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0b45 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.743485:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8255 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b45 expref: 32 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.743498:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8255 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b45 expref: 32 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.743515:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3600) 00010000:00010000:3.0:1788652333.743518:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788652333.743522:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e4400, rc 0) 00000100:00100000:3.0:1788652333.743580:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+32:11046:x1875537603675392:12345-192.168.203.50@tcp:101:bash.0 Request processed in 191us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652333.743586:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 193 00000100:00100000:2.0:1788652333.747592:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652333.747946:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603675520 00000100:00100000:1.0:1788652333.747955:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603675520 00000100:00100000:1.0:1788652333.750715:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 58 00000100:00100000:1.0:1788652333.750739:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4924c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:11046:x1875537603675520:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:1.0:1788652333.750757:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652333.751205:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000294c0c8a/0x340ed74ef02a825c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0b4c expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788652333.751238:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9cab2a, atime: 0x6a9cab29, ctime: 0x6a9cab2a, blocks: 0xb 00010000:00010000:1.0:1788652333.751265:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=350s v=(0 0) 00010000:00010000:1.0:1788652333.751271:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652333.751280:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000294c0c8a/0x340ed74ef02a825c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b4c expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.751298:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000294c0c8a/0x340ed74ef02a825c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b4c expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652333.751313:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c8600, rc 0) 00000100:00100000:1.0:1788652333.751439:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4924c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:11046:x1875537603675520:12345-192.168.203.50@tcp:101:bash.0 Request processed in 710us (3856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652333.751464:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 58 00000100:00100000:2.0:1788652333.755586:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652333.755764:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603675648 00000100:00100000:3.0:1788652333.756216:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603675648 00002000:00010000:2.0:1788652333.756332:0:6683:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788652333.756338:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe4924df80 with x1875537603675648 ext(0->18446744073709551615) 00002000:00010000:2.0:1788652333.756350:0:6683:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbe4924df80. 00000100:00100000:2.0:1788652333.756386:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:2.0:1788652333.756396:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4924df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2347:x1875537603675648:12345-192.168.203.50@tcp:10:bash.0 00002000:00010000:2.0:1788652333.756815:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788652333.756819:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788652330 -> 1788652332 00002000:00010000:2.0:1788652333.756822:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788652329 -> 1788652329 00002000:00010000:2.0:1788652333.756836:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788652330 -> 1788652332 00002000:00010000:2.0:1788652333.756838:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788652333.757012:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4924df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:2347:x1875537603675648:12345-192.168.203.50@tcp:10:bash.0 Request processed in 616us (1434us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788652333.757030:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 5 00002000:00010000:2.0:1788652333.757034:0:6683:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788652333.757037:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe4924df80 with x1875537603675648 ext(0->18446744073709551615) 00002000:00010000:2.0:1788652333.757043:0:6683:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbe4924df80. 00000100:00100000:3.0:1788652333.840528:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652333.840721:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603675776 00000100:00100000:0.0:1788652333.840732:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603675776 00000100:00100000:0.0:1788652333.840833:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 194 00000100:00100000:0.0:1788652333.840844:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+32:11527:x1875537603675776:12345-192.168.203.50@tcp:34:lfs.0 00010000:00010000:0.0:1788652333.840925:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a8263 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.840942:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a8263 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.840954:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a8263 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.840969:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a826a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.840988:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a826a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.840995:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a826a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.841232:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8271 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.841241:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8271 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.841248:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8271 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788652333.841285:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8271 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.841296:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a8263 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.841302:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a8263 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.841308:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a8263 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.841314:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e56400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652333.841495:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a8263 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.841506:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a8263 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.841519:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:0.0:1788652333.841522:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652333.841526:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a8263 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.841541:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a8263 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.841554:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a826a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.841560:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a826a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.841566:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a826a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.841570:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e57a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652333.841573:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a826a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.841578:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a826a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.841586:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cbe48888000) 00010000:00010000:0.0:1788652333.841588:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652333.841590:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a826a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.841596:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a826a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.841609:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8271 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.841615:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8271 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.841626:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8271 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.841631:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e56e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652333.841634:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8271 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.841640:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8271 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.841647:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3600) 00010000:00010000:0.0:1788652333.841649:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652333.841652:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8271 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652333.841658:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a8271 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652333.841738:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+32:11527:x1875537603675776:12345-192.168.203.50@tcp:34:lfs.0 Request processed in 895us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652333.841746:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 194 00000100:00100000:0.0:1788652333.915609:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652333.916069:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603676032 00000100:00100000:3.0:1788652333.916078:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603676032 00000100:00100000:3.0:1788652333.916352:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 195 00000100:00100000:3.0:1788652333.916364:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe49268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+32:11530:x1875537603676032:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1788652333.916384:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652333.916407:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8278 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0b53 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.916479:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a827f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.916494:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a827f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.916505:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a827f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.916521:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8286 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.916528:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8286 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.916534:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8286 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.916826:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a828d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.916846:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a828d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.916853:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a828d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652333.916864:0:6701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788652333.916965:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a827f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.916972:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a827f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.916979:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a827f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.916985:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652333.916989:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a827f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.916995:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a827f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.917006:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:3.0:1788652333.917009:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652333.917013:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a827f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.917018:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a827f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.917029:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8286 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.917041:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8286 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.917046:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8286 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.917050:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652333.917053:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8286 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.917059:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8286 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.917066:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cbe7fde3300) 00010000:00010000:3.0:1788652333.917068:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652333.917070:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8286 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.917075:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8286 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.917567:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8278 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b53 expref: 35 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.917586:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a828d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b53 expref: 34 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.917593:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3600) 00010000:00010000:3.0:1788652333.917596:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788652333.917605:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5400, rc 0) 00000100:00100000:3.0:1788652333.917680:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe49268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+34:11530:x1875537603676032:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 1318us (2080us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1788652333.917688:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 195 00000100:00100000:2.0:1788652333.928040:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652333.930940:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603676160 00000100:00100000:3.0:1788652333.930957:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603676160 00000100:00100000:3.0:1788652333.931033:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 196 00000100:00100000:3.0:1788652333.931044:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4924e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+34:11530:x1875537603676160:12345-192.168.203.50@tcp:54:lfs.0 00010000:00010000:3.0:1788652333.931116:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a829b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.931133:0:11683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8240 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b3e expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.931143:0:11683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a829b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.931178:0:11683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8240 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b3e expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.931192:0:11683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8240 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b3e expref: 34 pid: 5837 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652333.931207:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f8d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11683:1875537627785728:192.168.203.50@tcp:104: 00000100:00100000:3.0:1788652333.931334:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe473a9780 going to sleep for 11 seconds 00000100:00100000:3.0:1788652333.934377:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f8d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11683:1875537627785728:192.168.203.50@tcp:104: 00010000:00010000:3.0:1788652333.934406:0:11683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a829b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652333.940660:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652333.940912:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603676416 00000100:00100000:3.0:1788652333.940922:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603676416 00000100:00100000:3.0:1788652333.940982:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 52 00000100:00100000:3.0:1788652333.940992:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4924f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+35:5585:x1875537603676416:12345-192.168.203.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788652333.941341:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4924f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+36:5585:x1875537603676416:12345-192.168.203.50@tcp:35:ldlm_bl.0 Request processed in 349us (689us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788652333.941349:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 52 00000100:00100000:1.0:1788652333.951748:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652333.952265:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603676544 00000100:00100000:2.0:1788652333.952275:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603676544 00010000:00010000:2.0:1788652333.952314:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8240 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b3e expref: 36 pid: 5837 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652333.952362:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 73 00000100:00100000:2.0:1788652333.952372:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+36:2347:x1875537603676544:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652333.952387:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652333.952394:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8240 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b3e expref: 36 pid: 5837 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.952408:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8240 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b3e expref: 36 pid: 5837 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.952429:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8240 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b3e expref: 36 pid: 5837 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.952464:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3600) 00010000:00010000:2.0:1788652333.952469:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a829b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.952479:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a829b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.952487:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a829b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652333.952516:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652333.952570:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+35:2347:x1875537603676544:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 199us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652333.952577:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 73 00010000:00010000:3.0:1788652333.952671:0:11683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a829b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.952679:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a829b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.952709:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a829b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.952716:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a829b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.952722:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a829b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.952735:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652333.952739:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a829b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.952746:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a829b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.952765:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3600) 00010000:00010000:3.0:1788652333.952768:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788652333.952955:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a829b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652333.952963:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a829b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652333.953850:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4924e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+34:11530:x1875537603676160:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 22803us (25814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652333.953861:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 196 00000100:00100000:3.0:1788652333.959256:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652333.962477:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603676800 00000100:00100000:1.0:1788652333.962493:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603676800 00000100:00100000:1.0:1788652333.962564:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 53 00000100:00100000:1.0:1788652333.962575:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+34:11530:x1875537603676800:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:1.0:1788652333.963013:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+35:11530:x1875537603676800:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 439us (3765us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788652333.963023:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 53 00000100:00100000:3.0:1788652334.057280:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652334.060240:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603677056 00000100:00100000:0.0:1788652334.060255:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603677056 00000100:00100000:0.0:1788652334.060587:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 197 00000100:00100000:0.0:1788652334.060603:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+35:11541:x1875537603677056:12345-192.168.203.50@tcp:101:cat.0 00010000:00010000:0.0:1788652334.060645:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652334.060670:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a82a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0b5a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.060758:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a82a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.060792:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a82a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.060805:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a82a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.060819:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a82b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.060825:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a82b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.060832:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a82b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.061083:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a82b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.061093:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a82b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.061099:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a82b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652334.061108:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788652334.061201:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a82a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.061209:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a82a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.061216:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a82a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.061221:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e56400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652334.061226:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a82a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.061234:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a82a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.061245:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:0.0:1788652334.061248:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652334.061253:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a82a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.061259:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a82a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.061283:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a82b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.061291:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a82b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.061296:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a82b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.061311:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e56800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652334.061329:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a82b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.061336:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a82b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.061343:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cbe48888000) 00010000:00010000:0.0:1788652334.061346:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652334.061349:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a82b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.061354:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a82b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.061400:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a82a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b5a expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.061413:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a82b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b5a expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.061420:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3600) 00010000:00010000:0.0:1788652334.061422:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788652334.061425:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e56e00, rc 0) 00000100:00100000:0.0:1788652334.061497:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+37:11541:x1875537603677056:12345-192.168.203.50@tcp:101:cat.0 Request processed in 900us (4225us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788652334.061505:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 197 00000100:00080000:2.0:1788652334.061582:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652334.068438:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652334.068550:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603677312 00000100:00100000:1.0:1788652334.068561:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603677312 00000100:00100000:1.0:1788652334.068646:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 54 00000100:00100000:1.0:1788652334.068658:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4924ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+37:11541:x1875537603677312:12345-192.168.203.50@tcp:35:cat.0 00000100:00100000:1.0:1788652334.068966:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4924ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+38:11541:x1875537603677312:12345-192.168.203.50@tcp:35:cat.0 Request processed in 309us (534us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788652334.068975:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 54 00000100:00100000:3.0:1788652334.109093:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652334.109206:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603677568 00000100:00100000:1.0:1788652334.109216:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603677568 00000100:00100000:1.0:1788652334.109277:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 198 00000100:00100000:1.0:1788652334.109288:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+38:11542:x1875537603677568:12345-192.168.203.50@tcp:36:rm.0 00010000:00010000:1.0:1788652334.109426:0:6701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788652334.109451:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a82b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b5a expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.109467:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a828d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b53 expref: 37 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.109488:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a8255 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b45 expref: 36 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.109495:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe7fde3600) 00010000:00010000:1.0:1788652334.109503:0:6701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788652334.109521:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a82c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.109530:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a82c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.109536:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a82c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.109545:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a82cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.109549:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a82cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.109553:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a82cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.112249:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a82d3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.112267:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a82d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.112279:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a82d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788652334.114745:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1788652334.114760:0:6701:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 351097986911ns, next at 352097984288ns, rc = 0 00010000:00010000:2.0:1788652334.115627:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a82da lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.115669:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a82da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.115681:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a82da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.115690:0:6701:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a82da lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.115696:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a82da lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.115702:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a82da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.116141:0:6701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652334.116165:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a82d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.116173:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a82d3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.116180:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a82d3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.116186:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652334.116190:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a82d3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.116199:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a82d3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.116223:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe485acc00) 00010000:00010000:2.0:1788652334.116226:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788652334.116231:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a82d3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.116238:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a82d3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.116260:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a82c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.116267:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a82c5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.116273:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a82c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.116279:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652334.116282:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a82c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.116290:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a82c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.116849:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652334.116858:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a82da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.116865:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215fa00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:3.0:1788652334.116869:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a82da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.116984:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a82da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.116996:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cbe485acc00) 00010000:00010000:3.0:1788652334.116998:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788652334.117001:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a82da lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.117007:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a82da lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.117030:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652334.117041:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652334.117043:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652334.117207:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:2.0:1788652334.117211:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652334.117216:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a82c5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.117223:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a82c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788652334.117247:0:6701:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033924ec9 reply state 00000000732b6c19 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a82cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652334.117257:0:6701:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788652334.117498:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+37:11542:x1875537603677568:12345-192.168.203.50@tcp:36:rm.0 Request processed in 8206us (8409us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788652334.117508:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 198 00010000:00010000:2.0:1788652334.124994:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a82cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.125012:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a82cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.125021:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a82cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.125027:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c8c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652334.125032:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a82cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.125040:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a82cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.125058:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cbe48da0700) 00010000:00010000:2.0:1788652334.125062:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652334.125068:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a82cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.125074:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8c00/0x340ed74ef02a82cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652334.192824:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652334.193248:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603677824 00000100:00100000:0.0:1788652334.193258:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603677824 00000100:00100000:0.0:1788652334.193336:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 199 00000100:00100000:0.0:1788652334.193346:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+36:11548:x1875537603677824:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:0.0:1788652334.193390:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652334.193412:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a82e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0b61 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.193531:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a82e8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.193547:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a82e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.193559:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a82e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.193574:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a82ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.193581:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a82ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.193588:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a82ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788652334.196474:0:11683:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788652334.199555:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a82f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.199579:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a82f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.199593:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a82f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.200420:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a82e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.200428:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a82e8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.200435:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a82e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.200441:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e56400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652334.200446:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a82e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.200465:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a82e8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.200479:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:0.0:1788652334.200482:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652334.200487:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a82e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.200493:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a82e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788652334.200508:0:11683:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a0c2206 reply state 00000000c8dacd1a transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a82ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652334.200517:0:11683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788652334.200556:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a82e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b61 expref: 39 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.200586:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a82f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b61 expref: 38 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.200594:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe48888300) 00010000:00010000:0.0:1788652334.200597:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788652334.200599:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e56e00, rc 0) 00000100:00100000:0.0:1788652334.201381:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+39:11548:x1875537603677824:12345-192.168.203.50@tcp:101:bash.0 Request processed in 8030us (8561us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788652334.201391:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 199 00000100:00100000:3.0:1788652334.209408:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652334.210576:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603677952 00000100:00100000:1.0:1788652334.210588:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603677952 00000100:00080000:3.0:1788652334.210706:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788652334.210758:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 59 00000100:00100000:1.0:1788652334.210786:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2349:x1875537603677952:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:1.0:1788652334.210805:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652334.210826:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8d2aa58/0x340ed74ef02a8304 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0b68 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788652334.210864:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788652334.210886:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=351s v=(0 0) 00010000:00010000:1.0:1788652334.210891:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652334.210900:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8d2aa58/0x340ed74ef02a8304 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b68 expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.210921:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f8d2aa58/0x340ed74ef02a8304 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b68 expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.210936:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c8200, rc 0) 00010000:00010000:0.0:1788652334.210951:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a82ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.210963:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a82ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.210980:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a82ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.210987:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e57a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652334.210993:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a82ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652334.210994:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2349:x1875537603677952:12345-192.168.203.50@tcp:101:bash.0 Request processed in 227us (1595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652334.211011:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 59 00010000:00010000:0.0:1788652334.211011:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a82ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.211030:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cbe48888000) 00010000:00010000:0.0:1788652334.211033:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652334.211037:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a82ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.211051:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a82ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652334.217000:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788652334.217023:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f8d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627785856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788652334.217094:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652334.217234:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627785856 00000100:00100000:2.0:1788652334.217241:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627785856 00000100:00100000:2.0:1788652334.217308:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788652334.217328:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4926a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875537627785856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788652334.217370:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788652334.217427:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4926a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875537627785856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652334.217433:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1788652334.217600:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788652334.217733:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f8d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627785856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788652334.221187:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652334.221413:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603678080 00000100:00100000:2.0:1788652334.221423:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603678080 00000100:00100000:2.0:1788652334.221480:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 60 00000100:00100000:2.0:1788652334.221490:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:11548:x1875537603678080:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:2.0:1788652334.221507:0:8297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652334.221526:0:8297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025837c25/0x340ed74ef02a830b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0b6f expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.221559:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8d2aa58/0x340ed74ef02a8304 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b68 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.221569:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652334.221574:0:8297:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652334.221580:0:8297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025837c25/0x340ed74ef02a830b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b6f expref: 7 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.221613:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f8d2aa58/0x340ed74ef02a8304 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b68 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.221644:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f8d2aa58/0x340ed74ef02a8304 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b68 expref: 7 pid: 6680 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652334.221660:0:8297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4924f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8297:1875537627785984:192.168.203.50@tcp:104: 00000100:00100000:2.0:1788652334.221748:0:8297:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb300 going to sleep for 11 seconds 00000100:00100000:2.0:1788652334.223751:0:8297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4924f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8297:1875537627785984:192.168.203.50@tcp:104: 00010000:00010000:2.0:1788652334.224196:0:8297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000025837c25/0x340ed74ef02a830b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b6f expref: 7 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.224217:0:8297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215e400, rc 0) 00000100:00100000:2.0:1788652334.224666:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:11548:x1875537603678080:12345-192.168.203.50@tcp:101:bash.0 Request processed in 3176us (3486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652334.224676:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 60 00000100:00100000:3.0:1788652334.226852:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652334.229767:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603678208 00000100:00100000:1.0:1788652334.229823:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603678208 00010000:00010000:1.0:1788652334.229932:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f8d2aa58/0x340ed74ef02a8304 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b68 expref: 7 pid: 6680 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652334.229981:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 74 00000100:00100000:1.0:1788652334.229991:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2347:x1875537603678208:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652334.230006:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652334.230029:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f8d2aa58/0x340ed74ef02a8304 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b68 expref: 7 pid: 6680 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.230064:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f8d2aa58/0x340ed74ef02a8304 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b68 expref: 7 pid: 6680 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.230088:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8d2aa58/0x340ed74ef02a8304 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b68 expref: 7 pid: 6680 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.230758:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652334.230764:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652334.231388:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000025837c25/0x340ed74ef02a830b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b6f expref: 6 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.231411:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025837c25/0x340ed74ef02a830b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b6f expref: 6 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.231460:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000025837c25/0x340ed74ef02a830b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b6f expref: 6 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652334.231475:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe493baa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5822:1875537627786112:192.168.203.50@tcp:105: 00000100:00100000:1.0:1788652334.231578:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7f3200c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652334.237902:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe493baa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5822:1875537627786112:192.168.203.50@tcp:105: 00010000:00010000:1.0:1788652334.237930:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652334.237995:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2347:x1875537603678208:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 8004us (11151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652334.238007:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 74 00000100:00100000:0.0:1788652334.238797:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652334.240059:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603678464 00000100:00100000:2.0:1788652334.240079:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603678464 00000100:00100000:2.0:1788652334.240145:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 55 00000100:00100000:2.0:1788652334.240155:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe49268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+38:11548:x1875537603678464:12345-192.168.203.50@tcp:35:bash.0 00000100:00100000:2.0:1788652334.240519:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe49268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+39:11548:x1875537603678464:12345-192.168.203.50@tcp:35:bash.0 Request processed in 364us (1746us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788652334.240528:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 55 00010000:00010000:3.0:1788652334.344614:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652334.417823:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652334.418223:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603678592 00000100:00100000:0.0:1788652334.418235:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603678592 00000100:00100000:0.0:1788652334.418303:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 200 00000100:00100000:0.0:1788652334.418325:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+39:11564:x1875537603678592:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1788652334.418351:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652334.418373:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a8312 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0b76 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.418444:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a8319 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.418459:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a8319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.418472:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a8319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652334.418507:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788652334.418511:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788652334.418529:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a8319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.418571:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a8312 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b76 expref: 41 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.418590:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a8319 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b76 expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.418598:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:0.0:1788652334.418601:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788652334.418605:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e56800, rc 0) 00000100:00100000:0.0:1788652334.418675:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+40:11564:x1875537603678592:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 363us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652334.418682:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 200 00000100:00100000:0.0:1788652334.427326:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652334.431685:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603678848 00000100:00100000:2.0:1788652334.431701:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603678848 00000100:00100000:2.0:1788652334.431864:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 201 00000100:00100000:2.0:1788652334.431876:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4926a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+40:11564:x1875537603678848:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1788652334.431909:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652334.431931:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a8320 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0b7d expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.432033:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a8327 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.432047:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a8327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.432058:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a8327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652334.432068:0:6701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788652334.432190:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a8320 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b7d expref: 43 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.432209:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a8327 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b7d expref: 42 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.432218:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe48888300) 00010000:00010000:2.0:1788652334.432221:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788652334.432225:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215e200, rc 0) 00000100:00100000:2.0:1788652334.432295:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4926a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+42:11564:x1875537603678848:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 422us (4992us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788652334.432303:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 201 00000100:00100000:1.0:1788652334.442415:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652334.442476:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652334.442556:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603678976 00000100:00100000:2.0:1788652334.442567:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603678976 00000100:00100000:0.0:1788652334.442572:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603679232 00000100:00100000:0.0:1788652334.442579:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603679232 00000100:00100000:0.0:1788652334.442630:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 202 00000100:00100000:0.0:1788652334.442641:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+43:11564:x1875537603679232:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1788652334.442662:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652334.442682:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a8335 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0b84 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652334.442712:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00100000:2.0:1788652334.442736:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe494ac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+44:2347:x1875537603678976:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652334.442750:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652334.442811:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a8327 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b7d expref: 44 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.442812:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a833c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.442836:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a833c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.442866:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a833c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.443063:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe48888300) 00010000:00010000:2.0:1788652334.443070:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:0.0:1788652334.443107:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000100:00100000:2.0:1788652334.443137:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe494ac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+43:2347:x1875537603678976:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 402us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652334.443146:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 15 00010000:00010000:0.0:1788652334.443232:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a8335 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b84 expref: 44 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.443248:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a833c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b84 expref: 43 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.443255:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe48888300) 00010000:00010000:0.0:1788652334.443257:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788652334.443259:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e57a00, rc 0) 00000100:00100000:0.0:1788652334.443284:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+43:11564:x1875537603679232:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 646us (808us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788652334.443290:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 202 00000100:00100000:3.0:1788652334.454140:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652334.454233:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603679360 00000100:00100000:2.0:1788652334.454243:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603679360 00000100:00100000:2.0:1788652334.454305:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 61 00000100:00100000:2.0:1788652334.454328:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+6:2348:x1875537603679360:12345-192.168.203.50@tcp:1:lfs.0 00010000:00010000:2.0:1788652334.454386:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7de7351/0x340ed74ef02a834a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.454418:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000025837c25/0x340ed74ef02a830b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b6f expref: 6 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.454427:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652334.454432:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788652334.454437:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7de7351/0x340ed74ef02a834a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.454487:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000025837c25/0x340ed74ef02a830b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b6f expref: 6 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.454517:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000025837c25/0x340ed74ef02a830b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b6f expref: 6 pid: 8297 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652334.454533:0:6678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe4924f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6678:1875537627786240:192.168.203.50@tcp:104: 00000100:00100000:2.0:1788652334.454636:0:6678:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb180 going to sleep for 11 seconds 00000100:00100000:1.0:1788652334.464748:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652334.464854:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603679488 00000100:00100000:0.0:1788652334.464865:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603679488 00002000:00100000:0.0:1788652334.464925:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8cbe493b9c00 x1875537603679488/t0(0) o4->20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp:720/0 lens 504/0 e 0 to 0 dl 1788652345 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788652334.464937:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe493b9c00 with x1875537603679488 ext(0->8) 00010000:00010000:0.0:1788652334.464947:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000025837c25/0x340ed74ef02a830b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b6f expref: 7 pid: 8297 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.464965:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000025837c25/0x340ed74ef02a830b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b6f expref: 7 pid: 8297 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788652334.464994:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cbe493b9c00 00000100:00100000:0.0:1788652334.465032:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:0.0:1788652334.465043:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2347:x1875537603679488:12345-192.168.203.50@tcp:4:lfs.0 00000100:00100000:0.0:1788652334.465855:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:2347:x1875537603679488:12345-192.168.203.50@tcp:4:lfs.0 Request processed in 809us (1113us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788652334.465866:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 3 00002000:00100000:0.0:1788652334.465876:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8cbe493b9c00 x1875537603679488/t4294967308(0) o4->20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp:720/0 lens 504/448 e 0 to 0 dl 1788652345 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788652334.465886:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe493b9c00 with x1875537603679488 ext(0->8) 00010000:00010000:0.0:1788652334.465895:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000025837c25/0x340ed74ef02a830b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b6f expref: 9 pid: 8297 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.465911:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000025837c25/0x340ed74ef02a830b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b6f expref: 9 pid: 8297 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788652334.465919:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cbe493b9c00 00000100:00100000:2.0:1788652334.466116:0:6678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe4924f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6678:1875537627786240:192.168.203.50@tcp:104: 00010000:00010000:2.0:1788652334.466144:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f7de7351/0x340ed74ef02a834a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652334.471158:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652334.472473:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603679616 00000100:00100000:1.0:1788652334.472488:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603679616 00010000:00010000:1.0:1788652334.472541:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000025837c25/0x340ed74ef02a830b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b6f expref: 9 pid: 8297 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652334.472592:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 75 00000100:00100000:1.0:1788652334.472602:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe49268000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:2346:x1875537603679616:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652334.472618:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788652334.472638:0:5822:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788652334.472641:0:5822:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788652332 00002000:00010000:1.0:1788652334.472643:0:5822:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788652333 00002000:00010000:1.0:1788652334.472645:0:5822:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788652332 00010000:00010000:1.0:1788652334.472652:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000025837c25/0x340ed74ef02a830b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b6f expref: 9 pid: 8297 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.472667:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000025837c25/0x340ed74ef02a830b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b6f expref: 9 pid: 8297 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.472691:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025837c25/0x340ed74ef02a830b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b6f expref: 9 pid: 8297 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.472708:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788652334.472713:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788652334.472719:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7de7351/0x340ed74ef02a834a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.472755:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7de7351/0x340ed74ef02a834a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.472833:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652334.472903:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe49268000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2346:x1875537603679616:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 301us (2681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652334.472910:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 75 00010000:00010000:3.0:1788652334.474103:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f7de7351/0x340ed74ef02a834a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.474119:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7de7351/0x340ed74ef02a834a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.474153:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7de7351/0x340ed74ef02a834a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.474160:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7de7351/0x340ed74ef02a834a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.474168:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7de7351/0x340ed74ef02a834a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.474175:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e200 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:3.0:1788652334.474180:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7de7351/0x340ed74ef02a834a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.474202:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7de7351/0x340ed74ef02a834a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.474218:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7de7351/0x340ed74ef02a834a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.474237:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7de7351/0x340ed74ef02a834a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652334.474339:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2348:x1875537603679360:12345-192.168.203.50@tcp:1:lfs.0 Request processed in 20021us (20205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652334.474349:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 61 00000100:00100000:0.0:1788652334.490031:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652334.490605:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603679872 00000100:00100000:1.0:1788652334.490616:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603679872 00000100:00100000:1.0:1788652334.490681:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 56 00000100:00100000:1.0:1788652334.490691:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe47b4b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+43:11564:x1875537603679872:12345-192.168.203.50@tcp:35:lfs.0 00000004:00010000:1.0:1788652334.490813:0:5839:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a833c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b84 expref: 43 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788652334.491067:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1788652334.491112:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1788652334.494909:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1788652334.495019:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8351 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.495052:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a82f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b61 expref: 47 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.495063:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8351 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.495106:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a82f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b61 expref: 47 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.495141:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a82f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b61 expref: 47 pid: 11683 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652334.495157:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5839:1875537627786368:192.168.203.50@tcp:104: 00000100:00100000:1.0:1788652334.495282:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7f3200c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652334.499968:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652334.500730:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603680000 00000100:00100000:3.0:1788652334.500743:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603680000 00010000:00010000:3.0:1788652334.500817:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a82f6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b61 expref: 48 pid: 11683 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652334.500880:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 76 00000100:00100000:3.0:1788652334.500890:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4924f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+48:2346:x1875537603680000:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652334.500904:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652334.500911:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a82f6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b61 expref: 48 pid: 11683 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.500924:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a82f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b61 expref: 48 pid: 11683 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.500969:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe48888300) 00010000:00010000:3.0:1788652334.500974:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8351 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.500983:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8351 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.500991:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8351 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.501011:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788652334.501171:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a82f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b61 expref: 48 pid: 11683 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652334.501188:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5839:1875537627786368:192.168.203.50@tcp:104: 00010000:00010000:1.0:1788652334.501219:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8351 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.501244:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8351 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.501250:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8351 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788652334.501382:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000100:00100000:3.0:1788652334.501799:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4924f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+48:2346:x1875537603680000:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 879us (1809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652334.501810:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 76 00000001:00080000:1.0:1788652334.504155:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1788652334.504335:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1875537627786496:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788652334.504428:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652334.504685:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627786496 00000100:00100000:2.0:1788652334.504693:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627786496 00000100:00100000:2.0:1788652334.504751:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788652334.504792:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe759aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1875537627786496:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1788652334.506036:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788652334.516741:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe759aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1875537627786496:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 11973us (12303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652334.516767:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788652334.528032:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe49d3c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652334.528082:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1875537627786496:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788652334.545541:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1788652334.545655:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe759a8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1875537627786624:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788652334.546031:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652334.546168:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b75a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788652334.546744:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627786624 00000100:00100000:2.0:1788652334.546755:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627786624 00000100:00100000:2.0:1788652334.546848:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788652334.546858:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5839:x1875537627786624:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788652334.547408:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a0c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5839:x1875537627786624:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 549us (1376us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788652334.547419:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788652334.547577:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe759a8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5839:1875537627786624:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788652334.547651:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1788652334.547698:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8351 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.547710:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8351 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.547717:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8351 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.547724:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c8400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652334.547729:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8351 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.547737:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8351 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.547752:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe48888300) 00010000:00010000:1.0:1788652334.547755:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788652334.547760:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8351 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.547766:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8400/0x340ed74ef02a8351 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788652334.550573:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788652334.550741:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1788652334.550753:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 351533980634ns, next at 352533978014ns, rc = 0 00000001:00080000:2.0:1788652334.550764:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1788652334.551603:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe48888300) 00010000:00010000:2.0:1788652334.551610:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788652334.551621:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a833c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b84 expref: 51 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652334.551756:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe47b4b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+50:11564:x1875537603679872:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 61065us (61734us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1788652334.551767:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 56 00000020:00080000:2.0:1788652334.551790:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788652334.572373:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652334.573078:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603680128 00000100:00100000:3.0:1788652334.573090:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603680128 00000100:00100000:3.0:1788652334.573160:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 203 00000100:00100000:3.0:1788652334.573170:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4924f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+50:11564:x1875537603680128:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:3.0:1788652334.573194:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652334.573219:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8358 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0b8b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.573280:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8358 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b8b expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.573297:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8358 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b8b expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.573348:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:3.0:1788652334.573361:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788652334.573365:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e4200, rc 0) 00000100:00100000:3.0:1788652334.573439:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4924f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+51:11564:x1875537603680128:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 269us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652334.573456:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 203 00000100:00100000:1.0:1788652334.577295:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652334.577639:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603680384 00000100:00100000:2.0:1788652334.577649:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603680384 00000100:00100000:2.0:1788652334.577734:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00100000:2.0:1788652334.577745:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+51:11564:x1875537603680384:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:2.0:1788652334.578203:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+52:11564:x1875537603680384:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 458us (918us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1788652334.578212:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 57 00000100:00100000:0.0:1788652334.676397:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652334.676489:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603680512 00000100:00100000:2.0:1788652334.676499:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603680512 00000100:00100000:2.0:1788652334.676557:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 204 00000100:00100000:2.0:1788652334.676568:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe49269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+52:11574:x1875537603680512:12345-192.168.203.50@tcp:34:lfs.0 00010000:00010000:2.0:1788652334.676641:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a835f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.676675:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a835f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.676687:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a835f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.676705:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a8366 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.676819:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a8366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.676829:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a8366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.676931:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a836d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.676940:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a836d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.676948:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a836d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788652334.676987:0:6701:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a836d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.677000:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a835f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.677007:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a835f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.677025:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a835f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.677031:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215fa00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652334.677036:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a835f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.677044:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a835f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.677056:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:2.0:1788652334.677060:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652334.677065:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a835f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.677072:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a835f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.677085:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a8366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.677092:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a8366 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.677099:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a8366 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.677104:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652334.677106:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a8366 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.677124:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a8366 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.677133:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cbe485ac300) 00010000:00010000:2.0:1788652334.677136:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652334.677139:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a8366 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.677145:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a8366 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.677161:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a836d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.677167:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a836d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.677173:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a836d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.677178:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652334.677180:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a836d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.677186:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a836d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.677192:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:2.0:1788652334.677194:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652334.677197:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a836d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.677212:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a836d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652334.677304:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe49269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+52:11574:x1875537603680512:12345-192.168.203.50@tcp:34:lfs.0 Request processed in 736us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652334.677323:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 204 00000100:00100000:0.0:1788652334.732765:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652334.736874:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603680768 00000100:00100000:2.0:1788652334.736890:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603680768 00000100:00100000:2.0:1788652334.737014:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 205 00000100:00100000:2.0:1788652334.737026:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe49268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+52:11577:x1875537603680768:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1788652334.737055:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652334.737079:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a8374 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0b92 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.737148:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a837b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.737165:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a837b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.737177:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a837b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.737192:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8382 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.737200:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.737225:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.737361:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a8389 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.737371:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a8389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.737378:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a8389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652334.737388:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788652334.737481:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a837b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.737489:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a837b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.737495:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a837b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.737633:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652334.737637:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a837b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.737645:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a837b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.737656:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:2.0:1788652334.737660:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652334.737672:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a837b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.737679:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a837b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.737694:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.737865:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8382 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.737872:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8382 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.737878:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215fa00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652334.737882:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8382 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.737889:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8382 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.737898:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cbe485ac300) 00010000:00010000:2.0:1788652334.737900:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652334.737912:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8382 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.737919:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8382 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.737961:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a8374 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b92 expref: 55 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.737987:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a8389 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b92 expref: 54 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.737995:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:2.0:1788652334.737998:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788652334.738000:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215f400, rc 0) 00000100:00100000:2.0:1788652334.738066:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe49268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+54:11577:x1875537603680768:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 1042us (5311us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788652334.738074:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 205 00000100:00100000:1.0:1788652334.746018:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652334.749192:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603680896 00000100:00100000:3.0:1788652334.749207:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603680896 00000100:00100000:3.0:1788652334.749332:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 206 00000100:00100000:3.0:1788652334.749343:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a0c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+54:11577:x1875537603680896:12345-192.168.203.50@tcp:54:lfs.0 00010000:00010000:3.0:1788652334.749411:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8397 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.749428:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.749439:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.749464:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.749471:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8397 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.749477:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8397 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.749481:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652334.749498:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8397 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.749505:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8397 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.749517:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:3.0:1788652334.749520:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788652334.749525:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8397 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.749532:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a8397 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652334.751509:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a0c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+54:11577:x1875537603680896:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 2158us (5492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652334.751521:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 206 00000100:00100000:0.0:1788652334.758453:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652334.758555:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603681152 00000100:00100000:2.0:1788652334.758566:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603681152 00000100:00100000:2.0:1788652334.758660:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 58 00000100:00100000:2.0:1788652334.758672:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4926aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+54:11577:x1875537603681152:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:2.0:1788652334.758987:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4926aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+55:11577:x1875537603681152:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 317us (542us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788652334.758995:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 58 00000100:00100000:0.0:1788652334.843206:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652334.843962:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603681408 00000100:00100000:3.0:1788652334.843973:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603681408 00000100:00100000:3.0:1788652334.844036:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 207 00000100:00100000:3.0:1788652334.844048:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe49418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+55:11587:x1875537603681408:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:3.0:1788652334.844071:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652334.844074:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788652334.844100:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a8319 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b76 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.844127:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:3.0:1788652334.844133:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788652334.844145:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a839e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0b99 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.844255:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a83a5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.844269:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a8389 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b92 expref: 55 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.844278:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a83a5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.844309:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a8389 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b92 expref: 55 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.844335:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a8389 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b92 expref: 55 pid: 11683 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652334.844348:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f8d0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875537627786752:192.168.203.50@tcp:104: 00000100:00100000:3.0:1788652334.844448:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe473a9780 going to sleep for 11 seconds 00000100:00100000:3.0:1788652334.847574:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f8d0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875537627786752:192.168.203.50@tcp:104: 00010000:00010000:3.0:1788652334.847601:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a83a5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652334.849146:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652334.849226:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603681536 00000100:00100000:2.0:1788652334.849236:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603681536 00010000:00010000:2.0:1788652334.849274:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a8389 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b92 expref: 56 pid: 11683 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652334.849326:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 77 00000100:00100000:2.0:1788652334.849337:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4941b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+56:2347:x1875537603681536:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652334.849351:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652334.849382:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a8389 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b92 expref: 56 pid: 11683 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.849404:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a8389 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b92 expref: 56 pid: 11683 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.849428:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a8389 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b92 expref: 56 pid: 11683 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.849445:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:2.0:1788652334.849450:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a83a5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.849459:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a83a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.849467:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a83a5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.849500:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652334.849555:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4941b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+55:2347:x1875537603681536:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 220us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652334.849562:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 77 00010000:00010000:0.0:1788652334.850558:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a83a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.850582:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a83a5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652334.850601:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788652334.850803:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5c00/0x340ed74ef02a839e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b99 expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.850828:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a83a5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b99 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.850837:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:0.0:1788652334.850840:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788652334.850842:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e4c00, rc 0) 00000100:00100000:0.0:1788652334.850892:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe49418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+55:11587:x1875537603681408:12345-192.168.203.50@tcp:101:bash.0 Request processed in 6846us (7694us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788652334.850900:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 207 00000100:00100000:0.0:1788652334.854460:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652334.854599:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603681792 00000100:00100000:2.0:1788652334.854609:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603681792 00000100:00100000:2.0:1788652334.854664:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 208 00000100:00100000:2.0:1788652334.854674:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+55:11587:x1875537603681792:12345-192.168.203.50@tcp:36:bash.0 00010000:00010000:2.0:1788652334.854983:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a83b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.855012:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a83b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.855025:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a83b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788652334.855081:0:11683:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1788652334.855109:0:11683:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009670edc8 reply state 0000000044011270 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a83b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652334.855118:0:11683:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788652334.855586:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+58:11587:x1875537603681792:12345-192.168.203.50@tcp:36:bash.0 Request processed in 911us (1134us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788652334.855595:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 208 00000020:00080000:2.0:1788652334.855600:0:11683:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788652334.858594:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a83b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.858612:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a83b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.858619:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a83b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.858625:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215fa00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652334.858630:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a83b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.858652:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a83b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.858668:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:0.0:1788652334.858671:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652334.858676:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a83b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.858683:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a83b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652334.860914:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652334.861011:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603681920 00000100:00100000:3.0:1788652334.861115:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603681920 00000100:00100000:3.0:1788652334.861201:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 209 00000100:00100000:3.0:1788652334.861211:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+57:11587:x1875537603681920:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:3.0:1788652334.861232:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652334.861263:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a83ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0ba0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.861346:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a83c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.861358:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a83a5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b99 expref: 58 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.861366:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a83c1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.861396:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a83a5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b99 expref: 58 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.861408:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a83a5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b99 expref: 58 pid: 5836 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652334.861420:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f8d0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875537627786880:192.168.203.50@tcp:104: 00000100:00100000:3.0:1788652334.861508:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe473a9780 going to sleep for 11 seconds 00000100:00100000:2.0:1788652334.866702:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652334.868282:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603682048 00000100:00100000:1.0:1788652334.868310:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603682048 00010000:00010000:1.0:1788652334.868370:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a83a5 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b99 expref: 59 pid: 5836 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652334.868421:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 78 00000100:00100000:1.0:1788652334.868431:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4924ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+59:2347:x1875537603682048:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652334.868444:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652334.868451:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a83a5 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b99 expref: 59 pid: 5836 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.868465:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a83a5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b99 expref: 59 pid: 5836 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.868485:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:1.0:1788652334.868490:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a83c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.868500:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a83c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.868508:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a83c1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.868526:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652334.868588:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4924ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+59:2347:x1875537603682048:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 158us (1895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652334.868595:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 78 00010000:00010000:3.0:1788652334.869441:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a83a5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b99 expref: 58 pid: 5836 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652334.869461:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f8d0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875537627786880:192.168.203.50@tcp:104: 00010000:00010000:3.0:1788652334.869484:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a83c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.870268:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a83c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.870280:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a83c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652334.870338:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788652334.870342:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788652334.870440:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a83c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.870475:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4400/0x340ed74ef02a83ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ba0 expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.870493:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a83c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ba0 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.870500:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:0.0:1788652334.870515:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788652334.870520:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5400, rc 0) 00000100:00100000:0.0:1788652334.870648:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+57:11587:x1875537603681920:12345-192.168.203.50@tcp:101:bash.0 Request processed in 9437us (9742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652334.870657:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 209 00000100:00100000:2.0:1788652334.874569:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652334.874706:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603682304 00000100:00100000:3.0:1788652334.874715:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603682304 00000100:00100000:3.0:1788652334.874812:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 59 00000100:00100000:3.0:1788652334.874823:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4924d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+57:11587:x1875537603682304:12345-192.168.203.50@tcp:35:bash.0 00000100:00100000:3.0:1788652334.875067:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4924d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+58:11587:x1875537603682304:12345-192.168.203.50@tcp:35:bash.0 Request processed in 245us (507us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1788652334.875075:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 59 00000100:00100000:1.0:1788652334.949726:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652334.949981:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603682432 00000100:00100000:0.0:1788652334.949992:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603682432 00000100:00100000:0.0:1788652334.950096:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 210 00000100:00100000:0.0:1788652334.950107:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+58:11593:x1875537603682432:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1788652334.950130:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652334.950152:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a83c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0ba7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.950238:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a83cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.950253:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a83cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.950265:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a83cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652334.950310:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788652334.950323:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788652334.950340:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a83cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.950364:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a83c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ba7 expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.950395:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a83cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ba7 expref: 59 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.950404:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:0.0:1788652334.950407:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788652334.950411:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e56400, rc 0) 00000100:00100000:0.0:1788652334.950478:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+59:11593:x1875537603682432:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 372us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652334.950485:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 210 00000100:00100000:0.0:1788652334.962628:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652334.963165:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603682560 00000100:00100000:2.0:1788652334.963176:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603682560 00000100:00100000:2.0:1788652334.963239:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 211 00000100:00100000:2.0:1788652334.963251:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+59:11593:x1875537603682560:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1788652334.963278:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652334.963300:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a83d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0bae expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.963375:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a83dd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.963391:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a83dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.963416:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a83dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.963433:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a83e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.963441:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a83e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.963448:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a83e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.963535:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a83eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.963545:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a83eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.963552:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a83eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652334.963587:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788652334.963591:0:11683:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788652334.963739:0:11683:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a83eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.963753:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a83eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.963762:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a83dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.963813:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a83dd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.963820:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a83dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.963826:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215f400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652334.963830:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a83dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.963838:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a83dd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.963850:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:2.0:1788652334.963854:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652334.963858:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a83dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.963864:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a83dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.965037:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a83e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.965052:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a83e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.965059:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a83e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.965199:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215fa00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652334.965216:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a83e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.965225:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a83e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.965240:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cbe485ac300) 00010000:00010000:2.0:1788652334.965243:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652334.965247:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a83e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.965254:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a83e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.965450:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a83d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bae expref: 61 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.965467:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a83eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bae expref: 60 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.965474:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:2.0:1788652334.965476:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788652334.965479:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215e400, rc 0) 00000100:00100000:2.0:1788652334.965541:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+60:11593:x1875537603682560:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 2292us (2933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652334.965550:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 211 00000100:00100000:2.0:1788652334.972895:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652334.972986:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652334.973059:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603682944 00000100:00100000:3.0:1788652334.973076:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603682944 00000100:00100000:3.0:1788652334.973137:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:3.0:1788652334.973147:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4924c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+60:2348:x1875537603682944:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652334.973161:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652334.973182:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a83eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bae expref: 60 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652334.973200:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:3.0:1788652334.973205:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652334.973259:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4924c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+59:2348:x1875537603682944:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 114us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652334.973277:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:0.0:1788652334.973929:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603682816 00000100:00100000:0.0:1788652334.973937:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603682816 00000100:00100000:0.0:1788652334.973981:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 212 00000100:00100000:0.0:1788652334.973989:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4924f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+59:11593:x1875537603682816:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1788652334.974006:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652334.974023:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a83f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0bb5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.974123:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a83f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.974137:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a83c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ba0 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.974145:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a83f9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.974195:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a83c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ba0 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.974210:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a83c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ba0 expref: 60 pid: 5835 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652334.974224:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe513b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875537627787008:192.168.203.50@tcp:104: 00000100:00100000:0.0:1788652334.974309:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe42b56780 going to sleep for 11 seconds 00000100:00100000:1.0:1788652334.977030:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652334.977274:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe513b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875537627787008:192.168.203.50@tcp:104: 00010000:00010000:0.0:1788652334.977303:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a83f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652334.977335:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603683072 00000100:00100000:2.0:1788652334.977346:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603683072 00010000:00010000:2.0:1788652334.977389:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a83c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ba0 expref: 61 pid: 5835 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652334.977468:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 79 00000100:00100000:2.0:1788652334.977479:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51381500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+61:2347:x1875537603683072:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652334.977492:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652334.977500:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a83c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ba0 expref: 61 pid: 5835 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.977513:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a83c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ba0 expref: 61 pid: 5835 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.977534:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5400/0x340ed74ef02a83c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ba0 expref: 61 pid: 5835 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.977549:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:2.0:1788652334.977554:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a83f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.977562:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a83f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.977569:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a83f9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652334.977600:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652334.977656:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51381500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+60:2347:x1875537603683072:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 178us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652334.977663:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 79 00010000:00010000:0.0:1788652334.977725:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a83f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.977733:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a83f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652334.977751:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788652334.977943:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a83f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bb5 expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.977973:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a83f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bb5 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.977981:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:0.0:1788652334.977983:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788652334.977993:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e56800, rc 0) 00000100:00100000:0.0:1788652334.978019:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4924f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+60:11593:x1875537603682816:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 4031us (5033us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788652334.978025:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 212 00000100:00100000:2.0:1788652334.983583:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652334.983871:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603683328 00000100:00100000:1.0:1788652334.983883:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603683328 00000100:00100000:1.0:1788652334.984368:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:1.0:1788652334.984381:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe494ad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+60:11593:x1875537603683328:12345-192.168.203.50@tcp:103:lfs.0 00010000:00010000:1.0:1788652334.984398:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652334.984423:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8358 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b8b expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652334.984442:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:1.0:1788652334.984447:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652334.984546:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe494ad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+59:11593:x1875537603683328:12345-192.168.203.50@tcp:103:lfs.0 Request processed in 167us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652334.984554:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:1.0:1788652334.993409:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652334.993516:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603683456 00000100:00100000:0.0:1788652334.993526:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603683456 00000100:00100000:0.0:1788652334.993645:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 213 00000100:00100000:0.0:1788652334.993657:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51381500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+59:11593:x1875537603683456:12345-192.168.203.50@tcp:58:lfs.0 00010000:00010000:0.0:1788652334.993810:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a8407 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.993827:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a8407 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.993838:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a8407 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788652334.994093:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788652334.994190:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51381500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+59:11593:x1875537603683456:12345-192.168.203.50@tcp:58:lfs.0 Request processed in 533us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652334.994197:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 213 00000100:00100000:2.0:1788652334.996607:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652334.996869:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603683584 00000100:00100000:0.0:1788652334.996878:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603683584 00000100:00100000:0.0:1788652334.996967:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 214 00000100:00100000:0.0:1788652334.996979:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4924f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+59:11593:x1875537603683584:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1788652334.996998:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652334.997209:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a840e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0bbc expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.997287:0:11683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a8407 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.997298:0:11683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a840e lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bbc expref: 60 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.997325:0:11683:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a8407 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.997337:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a840e lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bbc expref: 60 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.997349:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:0.0:1788652334.997352:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788652334.997356:0:11683:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a840e lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bbc expref: 60 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652334.997362:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe49e56e00, rc 0) 00000100:00100000:0.0:1788652334.997458:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4924f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+60:11593:x1875537603683584:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 482us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652334.997466:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 214 00000040:00080000:3.0:1788652335.243044:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788652335.243053:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788652335.243089:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788652335.243104:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788652335.243223:0:11670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f8d0700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1875537627787136:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788652335.243341:0:11670:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe473a9480 going to sleep for 11 seconds 00000100:00100000:2.0:1788652335.254070:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652335.254266:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603683712 00000100:00100000:0.0:1788652335.254276:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603683712 00000100:00100000:0.0:1788652335.254348:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 215 00000100:00100000:0.0:1788652335.254358:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4924ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+61:11594:x1875537603683712:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788652335.254388:0:5835:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788652335.254507:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4924ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+61:11594:x1875537603683712:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 149us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652335.254515:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 215 00000100:00100000:3.0:1788652335.254612:0:11670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f8d0700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1875537627787136:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788652335.257670:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652335.257766:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603683840 00000100:00100000:0.0:1788652335.257799:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603683840 00000100:00100000:0.0:1788652335.257857:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 216 00000100:00100000:0.0:1788652335.257872:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4924c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+60:11594:x1875537603683840:12345-192.168.203.50@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788652335.257963:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10e00/0x340ed74ef02a8415 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.257982:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10e00/0x340ed74ef02a8415 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.257996:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10e00/0x340ed74ef02a8415 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258011:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11000/0x340ed74ef02a841c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258018:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11000/0x340ed74ef02a841c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258023:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11000/0x340ed74ef02a841c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258043:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11c00/0x340ed74ef02a8423 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258050:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11c00/0x340ed74ef02a8423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258056:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11c00/0x340ed74ef02a8423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652335.258199:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788652335.258203:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788652335.258214:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11c00/0x340ed74ef02a8423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258225:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10e00/0x340ed74ef02a8415 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258231:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10e00/0x340ed74ef02a8415 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258236:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10e00/0x340ed74ef02a8415 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258243:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7fd10e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652335.258247:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10e00/0x340ed74ef02a8415 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258254:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10e00/0x340ed74ef02a8415 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258264:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbe7fde3200) 00010000:00010000:0.0:1788652335.258267:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652335.258272:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10e00/0x340ed74ef02a8415 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258278:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10e00/0x340ed74ef02a8415 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258291:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11000/0x340ed74ef02a841c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258307:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11000/0x340ed74ef02a841c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258322:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11000/0x340ed74ef02a841c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258327:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7fd11000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652335.258331:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11000/0x340ed74ef02a841c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258337:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11000/0x340ed74ef02a841c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258344:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8cbe48888000) 00010000:00010000:0.0:1788652335.258347:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652335.258350:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11000/0x340ed74ef02a841c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258356:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11000/0x340ed74ef02a841c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258371:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11c00/0x340ed74ef02a8423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258376:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11c00/0x340ed74ef02a8423 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258381:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11c00/0x340ed74ef02a8423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258387:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7fd11c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652335.258397:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11c00/0x340ed74ef02a8423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258404:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11c00/0x340ed74ef02a8423 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258412:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:0.0:1788652335.258415:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652335.258418:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11c00/0x340ed74ef02a8423 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.258424:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11c00/0x340ed74ef02a8423 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652335.258500:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4924c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+60:11594:x1875537603683840:12345-192.168.203.50@tcp:34:lhsmtool_posix.0 Request processed in 633us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652335.258508:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 216 00000100:00100000:1.0:1788652335.261668:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652335.261831:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603684096 00000100:00100000:0.0:1788652335.261841:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603684096 00000100:00100000:0.0:1788652335.261949:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 217 00000100:00100000:0.0:1788652335.261959:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+60:11594:x1875537603684096:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788652335.261978:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652335.261996:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11e00/0x340ed74ef02a842a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0bc3 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.262383:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11a00/0x340ed74ef02a8431 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.262400:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11a00/0x340ed74ef02a8431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.262430:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11a00/0x340ed74ef02a8431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652335.262443:0:11683:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788652335.262549:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11a00/0x340ed74ef02a8431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.262557:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11a00/0x340ed74ef02a8431 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.262563:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11a00/0x340ed74ef02a8431 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.262567:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7fd11a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652335.262572:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11a00/0x340ed74ef02a8431 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.262578:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11a00/0x340ed74ef02a8431 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.262591:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:0.0:1788652335.262593:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788652335.262598:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11a00/0x340ed74ef02a8431 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.262603:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11a00/0x340ed74ef02a8431 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.262644:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11e00/0x340ed74ef02a842a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bc3 expref: 62 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.262664:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbe7fde3200) 00010000:00010000:0.0:1788652335.262666:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788652335.262670:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11e00/0x340ed74ef02a842a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bc3 expref: 62 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.262679:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7fd11e00, rc 0) 00000100:00100000:0.0:1788652335.263394:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+61:11594:x1875537603684096:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 1432us (1731us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1788652335.263403:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 217 00000100:00100000:2.0:1788652335.269156:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652335.270055:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603684224 00000100:00100000:0.0:1788652335.270127:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603684224 00000100:00100000:0.0:1788652335.270226:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 218 00000100:00100000:0.0:1788652335.270237:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81f24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+61:11594:x1875537603684224:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788652335.270272:0:5835:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788652335.270437:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81f24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+61:11594:x1875537603684224:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 201us (1290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652335.270445:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 218 00000100:00100000:2.0:1788652335.278540:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652335.278761:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603684480 00000100:00100000:3.0:1788652335.278816:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603684480 00000100:00100000:3.0:1788652335.279038:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 219 00000100:00100000:3.0:1788652335.279049:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+61:11594:x1875537603684480:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788652335.279076:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652335.279079:0:6701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788652335.279104:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56400/0x340ed74ef02a83cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ba7 expref: 61 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.279122:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:3.0:1788652335.279127:0:6701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788652335.279141:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a843f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0bca expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788652335.279534:0:6701:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1788652335.279739:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8446 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.279753:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.279763:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.280452:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a843f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bca expref: 63 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.280472:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8446 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bca expref: 62 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.280499:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cbe7fde3b00) 00010000:00010000:3.0:1788652335.280502:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788652335.280505:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e4a00, rc 0) 00000100:00100000:2.0:1788652335.281678:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+62:11594:x1875537603684480:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 2624us (3140us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788652335.281690:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 219 00000100:00100000:1.0:1788652335.288479:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652335.288590:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603684736 00000100:00100000:0.0:1788652335.288600:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603684736 00000100:00100000:0.0:1788652335.288678:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 220 00000100:00100000:0.0:1788652335.288687:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+62:11594:x1875537603684736:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788652335.288755:0:11683:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652335.288812:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a8446 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bca expref: 62 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.288851:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cbe7fde3b00) 00010000:00010000:0.0:1788652335.288861:0:11683:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788652335.288882:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11e00/0x340ed74ef02a8454 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.288895:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11e00/0x340ed74ef02a8454 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.288905:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11e00/0x340ed74ef02a8454 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.288919:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11a00/0x340ed74ef02a845b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x6b7e7efc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.288936:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11a00/0x340ed74ef02a845b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6b7e7efc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.288943:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11a00/0x340ed74ef02a845b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6b7e7efc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.289000:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11e00/0x340ed74ef02a8454 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.289008:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11e00/0x340ed74ef02a8454 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.289175:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11e00/0x340ed74ef02a8454 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.289182:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7fd11e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652335.289186:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11e00/0x340ed74ef02a8454 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.289200:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11e00/0x340ed74ef02a8454 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.289209:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:0.0:1788652335.289211:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652335.289215:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11e00/0x340ed74ef02a8454 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.289221:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11e00/0x340ed74ef02a8454 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.289231:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11a00/0x340ed74ef02a845b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6b7e7efc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.289237:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11a00/0x340ed74ef02a845b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6b7e7efc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.289253:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11a00/0x340ed74ef02a845b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6b7e7efc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.289258:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7fd11a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652335.289261:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11a00/0x340ed74ef02a845b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6b7e7efc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.289267:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11a00/0x340ed74ef02a845b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6b7e7efc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.289273:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x6b7e7efc (ffff8cbe48888000) 00010000:00010000:0.0:1788652335.289275:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652335.289278:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11a00/0x340ed74ef02a845b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6b7e7efc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.289292:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11a00/0x340ed74ef02a845b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6b7e7efc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652335.289434:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+61:11594:x1875537603684736:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 747us (964us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788652335.289441:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 220 00000100:00100000:1.0:1788652335.293225:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652335.293442:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603684864 00000100:00100000:0.0:1788652335.293451:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603684864 00000100:00100000:0.0:1788652335.293509:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 221 00000100:00100000:0.0:1788652335.293519:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe49268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+61:11594:x1875537603684864:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788652335.293538:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652335.293560:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11c00/0x340ed74ef02a8462 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0bd1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.293595:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11000/0x340ed74ef02a8469 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.293609:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11000/0x340ed74ef02a8469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.293620:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11000/0x340ed74ef02a8469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.293728:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11c00/0x340ed74ef02a8462 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bd1 expref: 63 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.293746:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11000/0x340ed74ef02a8469 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bd1 expref: 62 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.293767:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cbe48888d00) 00010000:00010000:0.0:1788652335.293801:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788652335.293806:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7fd11000, rc 0) 00000100:00100000:0.0:1788652335.293862:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe49268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+62:11594:x1875537603684864:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 344us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652335.295416:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 221 00000100:00100000:2.0:1788652335.300376:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652335.300998:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603685120 00000100:00100000:3.0:1788652335.301009:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603685120 00000100:00100000:3.0:1788652335.301158:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 222 00000100:00100000:3.0:1788652335.301173:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f16df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+62:11594:x1875537603685120:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788652335.301378:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a8470 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.301394:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a8470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.301406:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a8470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788652335.301622:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:3.0:1788652335.301630:0:6701:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 352284857662ns, next at 353284855765ns, rc = 0 00000004:00010000:3.0:1788652335.301767:0:6701:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067100075 reply state 0000000003bf412e transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a8470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652335.301801:0:6701:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788652335.302075:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f16df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+64:11594:x1875537603685120:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 906us (1707us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1788652335.302083:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 222 00010000:00010000:0.0:1788652335.305552:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a8470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.305567:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a8470 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.305574:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a8470 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.305581:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652335.305586:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a8470 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.305594:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a8470 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.305611:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cbe48888d00) 00010000:00010000:0.0:1788652335.305614:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788652335.305619:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a8470 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.305626:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a8470 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652335.306056:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652335.306138:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603685248 00000100:00100000:0.0:1788652335.306147:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603685248 00000100:00100000:0.0:1788652335.306199:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 223 00000100:00100000:0.0:1788652335.306209:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+63:11594:x1875537603685248:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788652335.306231:0:11683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652335.306258:0:11683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11c00/0x340ed74ef02a8477 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0bd8 expref: -99 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.306324:0:11683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11c00/0x340ed74ef02a8477 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bd8 expref: 64 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.306338:0:11683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11c00/0x340ed74ef02a8477 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bd8 expref: 64 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.306514:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cbe48888d00) 00010000:00010000:0.0:1788652335.306518:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788652335.306521:0:11683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7fd11c00, rc 0) 00000100:00100000:0.0:1788652335.306578:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+64:11594:x1875537603685248:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 371us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652335.306585:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 223 00000100:00100000:1.0:1788652335.312977:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652335.313145:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603685376 00000100:00100000:2.0:1788652335.313154:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603685376 00000100:00100000:2.0:1788652335.313264:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 62 00000100:00100000:2.0:1788652335.313276:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4941b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:2348:x1875537603685376:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788652335.313599:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4941b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+10:2348:x1875537603685376:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 Request processed in 325us (631us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788652335.313607:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 62 00000100:00080000:3.0:1788652335.313697:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788652335.315886:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652335.316055:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603685632 00000100:00100000:3.0:1788652335.316127:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603685632 00000100:00100000:3.0:1788652335.316173:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 60 00000100:00100000:3.0:1788652335.316183:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+64:11594:x1875537603685632:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788652335.316419:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+65:11594:x1875537603685632:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 236us (539us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1788652335.316428:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 60 00000100:00100000:0.0:1788652335.321866:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652335.322107:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603685888 00000100:00100000:1.0:1788652335.322118:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603685888 00000100:00100000:1.0:1788652335.322179:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 224 00000100:00100000:1.0:1788652335.322190:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+65:11594:x1875537603685888:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788652335.322524:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+65:11594:x1875537603685888:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 335us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652335.322532:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 224 00000100:00100000:1.0:1788652335.327453:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652335.328345:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603686016 00000100:00100000:3.0:1788652335.328357:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603686016 00000100:00100000:2.0:1788652335.328507:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 225 00000100:00100000:2.0:1788652335.328520:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+65:11594:x1875537603686016:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788652335.328540:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652335.328562:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a847e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0bdf expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.328631:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8485 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.328656:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.328668:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652335.328714:0:6701:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788652335.328733:0:6701:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.328760:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a847e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bdf expref: 67 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.328806:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8485 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bdf expref: 66 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.328826:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cbe48888d00) 00010000:00010000:2.0:1788652335.328831:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788652335.328835:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215fa00, rc 0) 00000100:00100000:2.0:1788652335.328911:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+66:11594:x1875537603686016:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 393us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652335.328927:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 225 00000100:00100000:2.0:1788652335.337923:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652335.338072:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603686144 00000100:00100000:1.0:1788652335.338094:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603686144 00000100:00100000:1.0:1788652335.338150:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 63 00000100:00100000:1.0:1788652335.338161:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+10:2346:x1875537603686144:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788652335.338179:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652335.338201:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060bcd8ed/0x340ed74ef02a848c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0be6 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788652335.338228:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cab2e, blocks: 0x1 00010000:00010000:1.0:1788652335.338247:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=352s v=(0 0) 00010000:00010000:1.0:1788652335.338252:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652335.338262:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060bcd8ed/0x340ed74ef02a848c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0be6 expref: 11 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652335.338280:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000060bcd8ed/0x340ed74ef02a848c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0be6 expref: 11 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652335.338293:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c9800, rc 0) 00000100:00100000:1.0:1788652335.338363:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+11:2346:x1875537603686144:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 203us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652335.338370:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 63 00000100:00100000:0.0:1788652335.345849:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652335.348049:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603686400 00000100:00100000:2.0:1788652335.348130:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603686400 00000100:00100000:2.0:1788652335.348322:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 226 00000100:00100000:2.0:1788652335.348335:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+66:11594:x1875537603686400:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788652335.348452:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+66:11594:x1875537603686400:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 120us (2883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652335.348518:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 226 00000100:00100000:2.0:1788652335.352188:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652335.353379:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603686528 00000100:00100000:1.0:1788652335.353392:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603686528 00000100:00100000:1.0:1788652335.353457:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 64 00000100:00100000:1.0:1788652335.353469:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+11:11594:x1875537603686528:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788652335.353486:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652335.353504:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8d2aa58/0x340ed74ef02a8493 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0bed expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652335.353550:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000060bcd8ed/0x340ed74ef02a848c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0be6 expref: 12 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652335.353559:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652335.353563:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652335.353580:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8d2aa58/0x340ed74ef02a8493 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bed expref: 12 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652335.353616:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000060bcd8ed/0x340ed74ef02a848c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0be6 expref: 12 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652335.353631:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000060bcd8ed/0x340ed74ef02a848c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0be6 expref: 12 pid: 6680 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652335.353651:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75986680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6679:1875537627787264:192.168.203.50@tcp:104: 00000100:00100000:1.0:1788652335.353750:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b75a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788652335.356409:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75986680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6679:1875537627787264:192.168.203.50@tcp:104: 00010000:00010000:1.0:1788652335.356444:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f8d2aa58/0x340ed74ef02a8493 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bed expref: 12 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652335.356467:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c8200, rc 0) 00000100:00100000:1.0:1788652335.356531:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+12:11594:x1875537603686528:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 3064us (4351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652335.356539:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 64 00000100:00100000:0.0:1788652335.357372:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652335.357445:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603686656 00000100:00100000:2.0:1788652335.357452:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603686656 00010000:00010000:2.0:1788652335.357485:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000060bcd8ed/0x340ed74ef02a848c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0be6 expref: 12 pid: 6680 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652335.357518:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 80 00000100:00100000:2.0:1788652335.357526:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+12:2346:x1875537603686656:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652335.357539:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652335.357560:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000060bcd8ed/0x340ed74ef02a848c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0be6 expref: 12 pid: 6680 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.357692:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000060bcd8ed/0x340ed74ef02a848c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0be6 expref: 12 pid: 6680 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.357715:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060bcd8ed/0x340ed74ef02a848c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0be6 expref: 12 pid: 6680 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.357731:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652335.357736:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652335.357745:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8d2aa58/0x340ed74ef02a8493 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bed expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.357755:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8d2aa58/0x340ed74ef02a8493 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bed expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.357850:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f8d2aa58/0x340ed74ef02a8493 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bed expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652335.358005:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe81a51c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5820:1875537627787392:192.168.203.50@tcp:105: 00000100:00100000:2.0:1788652335.358230:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652335.360232:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe81a51c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5820:1875537627787392:192.168.203.50@tcp:105: 00010000:00010000:1.0:1788652335.360259:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652335.360319:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+11:2346:x1875537603686656:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 2786us (2943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652335.360329:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 80 00000100:00100000:3.0:1788652335.362443:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652335.362543:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603686784 00000100:00100000:2.0:1788652335.362552:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603686784 00002000:00100000:2.0:1788652335.362614:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8cbe7f8d0700 x1875537603686784/t0(0) o4->20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp:721/0 lens 504/0 e 0 to 0 dl 1788652346 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788652335.362624:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe7f8d0700 with x1875537603686784 ext(0->12) 00002000:00010000:2.0:1788652335.362629:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbe7f8d0700 00000100:00100000:2.0:1788652335.362661:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:2.0:1788652335.362670:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+11:2346:x1875537603686784:12345-192.168.203.50@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788652335.363321:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+13:2346:x1875537603686784:12345-192.168.203.50@tcp:4:lhsmtool_posix.0 Request processed in 642us (877us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788652335.363330:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 6 00002000:00100000:2.0:1788652335.363338:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8cbe7f8d0700 x1875537603686784/t4294967320(0) o4->20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp:721/0 lens 504/448 e 0 to 0 dl 1788652346 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788652335.363346:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe7f8d0700 with x1875537603686784 ext(0->12) 00002000:00010000:2.0:1788652335.363350:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbe7f8d0700 00000100:00100000:0.0:1788652335.367064:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652335.367166:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603686912 00000100:00100000:1.0:1788652335.367175:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603686912 00000100:00100000:1.0:1788652335.367235:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 227 00000100:00100000:1.0:1788652335.367245:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+66:11594:x1875537603686912:12345-192.168.203.50@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1788652335.367942:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652335.431159:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+66:11594:x1875537603686912:12345-192.168.203.50@tcp:44:lhsmtool_posix.0 Request processed in 63905us (64095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652335.431188:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 227 00000001:00080000:2.0:1788652335.431226:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000020:00080000:2.0:1788652335.431258:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cbe49d3c840 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1788652335.431264:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbe744bf500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cbe49d3c6c0 00000020:00080000:2.0:1788652335.431267:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbe42d5a000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cbe74298c00 00000020:00080000:2.0:1788652335.431302:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cbe49d3c540 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1788652335.431306:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbe42d5ac00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cbe4a32c9c0 00000020:00080000:2.0:1788652335.431318:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbe42d5af00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cbe7f298000 00000004:00080000:2.0:1788652335.431345:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:2.0:1788652335.431362:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000001:00080000:2.0:1788652335.431375:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1788652335.431381:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:2.0:1788652335.431409:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788652335.431611:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788652335.431801:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe81a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627787520:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788652335.431859:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652335.432705:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788652335.433268:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe81a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627787648:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788652335.433543:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe81a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627787776:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788652335.433608:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652335.438583:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627787520 00000100:00100000:3.0:1788652335.438598:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627787520 00000100:00100000:3.0:1788652335.438660:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627787776 00000100:00100000:3.0:1788652335.438664:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627787776 00000100:00100000:3.0:1788652335.438691:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788652335.438700:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe742b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3303:x1875537627787520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788652335.438730:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1788652335.438764:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9cab2c, atime: 0x6a9cab2d, ctime: 0x6a9cab2c, blocks: 0x1 00010000:00010000:3.0:1788652335.438796:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002829f37f/0x340ed74ef02a849a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.438813:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=352s v=(0 0) 00010000:00010000:3.0:1788652335.438818:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652335.438824:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002829f37f/0x340ed74ef02a849a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.438841:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002829f37f/0x340ed74ef02a849a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.438887:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002829f37f/0x340ed74ef02a849a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.438896:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002829f37f/0x340ed74ef02a849a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.438917:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788652335.439797:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe742b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3303:x1875537627787520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1067us (7907us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788652335.439808:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788652335.440026:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788652335.440041:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1875537627787776:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788652335.440160:0:8297:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788652335.440164:0:8297:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788652334 00002000:00010000:0.0:1788652335.440166:0:8297:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788652335.440168:0:8297:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788652334 -> 1788652334 00002000:00010000:0.0:1788652335.440171:0:8297:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788652335.440207:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1875537627787776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 171us (6599us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788652335.440214:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:0.0:1788652335.440256:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cbe81a50700/2, rc 0, transno 4294967321 00000100:00100000:0.0:1788652335.440262:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe81a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627787776:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1788652335.440541:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652335.440549:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002829f37f/0x340ed74ef02a849a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.440559:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4c00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:3.0:1788652335.440563:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002829f37f/0x340ed74ef02a849a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652335.440693:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788652335.440744:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cbe81a50a80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788652335.440750:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe81a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627787520:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788652335.440791:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627787648 00000100:00100000:2.0:1788652335.440796:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627787648 00000100:00100000:2.0:1788652335.440828:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788652335.440835:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1875537627787648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788652335.440860:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1788652335.440891:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7de7351/0x340ed74ef02a84a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.440909:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000294c0c8a/0x340ed74ef02a825c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b4c expref: 12 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.440916:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788652335.440920:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788652335.440924:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7de7351/0x340ed74ef02a84a1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.440953:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000294c0c8a/0x340ed74ef02a825c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b4c expref: 12 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.440966:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000294c0c8a/0x340ed74ef02a825c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b4c expref: 12 pid: 6679 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652335.440979:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe81a53480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6680:1875537627787904:192.168.203.50@tcp:104: 00010000:00010000:3.0:1788652335.441146:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002829f37f/0x340ed74ef02a849a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.441163:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002829f37f/0x340ed74ef02a849a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.441171:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002829f37f/0x340ed74ef02a849a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.441196:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652335.441198:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652335.441200:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652335.441417:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652335.442017:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652335.442544:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603687040 00000100:00100000:2.0:1788652335.442553:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603687040 00000100:00100000:2.0:1788652335.442612:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 68 00000100:00100000:2.0:1788652335.442622:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+13:2347:x1875537603687040:12345-192.168.203.50@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788652335.450271:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe81a53480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6680:1875537627787904:192.168.203.50@tcp:104: 00010000:00010000:2.0:1788652335.450340:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f7de7351/0x340ed74ef02a84a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652335.456597:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652335.457055:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603687168 00000100:00100000:0.0:1788652335.457075:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603687168 00010000:00010000:0.0:1788652335.457122:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000294c0c8a/0x340ed74ef02a825c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b4c expref: 14 pid: 6679 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652335.457163:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 81 00000100:00100000:0.0:1788652335.457172:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+14:2346:x1875537603687168:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788652335.457188:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652335.457193:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000294c0c8a/0x340ed74ef02a825c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b4c expref: 14 pid: 6679 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.457208:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000294c0c8a/0x340ed74ef02a825c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b4c expref: 14 pid: 6679 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.457249:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000294c0c8a/0x340ed74ef02a825c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b4c expref: 14 pid: 6679 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.457267:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788652335.457271:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788652335.457278:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7de7351/0x340ed74ef02a84a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.457289:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7de7351/0x340ed74ef02a84a1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.457327:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652335.457377:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+13:2346:x1875537603687168:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 204us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652335.457384:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 81 00010000:00010000:0.0:1788652335.457409:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f7de7351/0x340ed74ef02a84a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.457419:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7de7351/0x340ed74ef02a84a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.457429:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7de7351/0x340ed74ef02a84a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.457439:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7de7351/0x340ed74ef02a84a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.457459:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788652335.458544:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3303:x1875537627787648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17704us (17847us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788652335.458554:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:0.0:1788652335.458878:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:3.0:1788652335.459021:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cbe81a52300/2, rc 0, transno 4294967322 00000100:00100000:3.0:1788652335.459029:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe81a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627787648:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788652335.459134:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7de7351/0x340ed74ef02a84a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.459145:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e200 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:0.0:1788652335.459149:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7de7351/0x340ed74ef02a84a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.459159:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7de7351/0x340ed74ef02a84a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.459177:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7de7351/0x340ed74ef02a84a1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.459184:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7de7351/0x340ed74ef02a84a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.459206:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652335.459207:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652335.459209:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788652335.493340:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:1.0:1788652335.493363:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:1.0:1788652335.493368:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:2.0:1788652335.493689:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2347:x1875537603687040:12345-192.168.203.50@tcp:16:lhsmtool_posix.0 Request processed in 51063us (51669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652335.493700:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 68 00000100:00100000:3.0:1788652335.496614:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652335.498281:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603687424 00000100:00100000:2.0:1788652335.498294:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603687424 00000100:00100000:2.0:1788652335.498416:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 228 00000100:00100000:2.0:1788652335.498427:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+20:11594:x1875537603687424:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788652335.498479:0:6701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652335.498507:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a8485 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bdf expref: 20 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.498526:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cbe48888d00) 00010000:00010000:2.0:1788652335.498531:0:6701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788652335.498560:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a84a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.498572:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a84a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.498582:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a84a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788652335.498875:0:6701:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb6fda21 reply state 000000009da274cc transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a84a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652335.500283:0:6701:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788652335.500418:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+21:11594:x1875537603687424:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 1988us (3810us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788652335.500427:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 228 00010000:00010000:3.0:1788652335.503048:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a84a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.503073:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a84a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.503082:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a84a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.503089:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652335.503094:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a84a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.503103:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a84a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.503120:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cbe48888d00) 00010000:00010000:3.0:1788652335.503128:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652335.503132:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a84a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.503138:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a84a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652335.504848:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652335.505595:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603687552 00000100:00100000:1.0:1788652335.505605:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603687552 00000100:00100000:1.0:1788652335.505662:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 69 00000100:00100000:1.0:1788652335.505672:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2346:x1875537603687552:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788652335.505914:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788652335.505918:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788652334 -> 1788652333 00002000:00010000:1.0:1788652335.505921:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788652333 00002000:00010000:1.0:1788652335.505923:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788652334 -> 1788652333 00002000:00010000:1.0:1788652335.505925:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788652335.505995:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2346:x1875537603687552:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 Request processed in 324us (1156us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788652335.506002:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 69 00000100:00100000:1.0:1788652335.519884:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652335.520194:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603687808 00000100:00100000:2.0:1788652335.520206:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603687808 00000100:00100000:2.0:1788652335.520262:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 229 00000100:00100000:2.0:1788652335.520272:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+20:11594:x1875537603687808:12345-192.168.203.50@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788652335.520355:0:11683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a84af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.520374:0:11683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11000/0x340ed74ef02a8469 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bd1 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.520385:0:11683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a84af lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.520420:0:11683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11000/0x340ed74ef02a8469 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bd1 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.520434:0:11683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11000/0x340ed74ef02a8469 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bd1 expref: 20 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652335.520448:0:11683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe81a53480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11683:1875537627788032:192.168.203.50@tcp:104: 00000100:00100000:2.0:1788652335.520561:0:11683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788652335.531696:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652335.532207:0:11683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe81a53480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11683:1875537627788032:192.168.203.50@tcp:104: 00010000:00010000:2.0:1788652335.532246:0:11683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a84af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652335.532464:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603687936 00000100:00100000:3.0:1788652335.532471:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603687936 00010000:00010000:3.0:1788652335.532508:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11000/0x340ed74ef02a8469 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bd1 expref: 21 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652335.532538:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 82 00000100:00100000:3.0:1788652335.532547:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f892680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+21:2346:x1875537603687936:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652335.532561:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652335.532568:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11000/0x340ed74ef02a8469 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bd1 expref: 21 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.532580:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11000/0x340ed74ef02a8469 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bd1 expref: 21 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.532601:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11000/0x340ed74ef02a8469 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bd1 expref: 21 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.532614:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cbe48888d00) 00010000:00010000:3.0:1788652335.532618:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a84af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.532627:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a84af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.532634:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a84af lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.532672:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788652335.532795:0:11683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a84af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.532802:0:11683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a84af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.532832:0:11683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a84af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.532839:0:11683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a84af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.532846:0:11683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a84af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.532851:0:11683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215fa00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652335.532861:0:11683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a84af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.532879:0:11683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a84af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.532888:0:11683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cbe48888d00) 00010000:00010000:2.0:1788652335.532891:0:11683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788652335.532895:0:11683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a84af lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.532901:0:11683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a84af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11683 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652335.533002:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f892680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+20:2346:x1875537603687936:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 455us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652335.533010:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 82 00000100:00100000:2.0:1788652335.533241:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+19:11594:x1875537603687808:12345-192.168.203.50@tcp:55:lhsmtool_posix.0 Request processed in 12969us (13366us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788652335.533251:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 229 00000100:00100000:0.0:1788652335.536477:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652335.536599:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603688064 00000100:00100000:2.0:1788652335.536609:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603688064 00000100:00100000:2.0:1788652335.536687:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 70 00000100:00100000:2.0:1788652335.536697:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2349:x1875537603688064:12345-192.168.203.50@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788652335.536738:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000025837c25/0x340ed74ef02a84b6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.536758:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8d2aa58/0x340ed74ef02a8493 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bed expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.536766:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652335.536800:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788652335.536805:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025837c25/0x340ed74ef02a84b6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.536840:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f8d2aa58/0x340ed74ef02a8493 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bed expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.536853:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f8d2aa58/0x340ed74ef02a8493 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bed expref: 8 pid: 6679 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652335.536956:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe81a53480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6680:1875537627788160:192.168.203.50@tcp:104: 00000100:00100000:2.0:1788652335.537046:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788652335.540041:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652335.540298:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe81a53480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6680:1875537627788160:192.168.203.50@tcp:104: 00010000:00010000:2.0:1788652335.540340:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000025837c25/0x340ed74ef02a84b6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652335.540587:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603688192 00000100:00100000:3.0:1788652335.540595:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603688192 00010000:00010000:3.0:1788652335.540630:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f8d2aa58/0x340ed74ef02a8493 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bed expref: 9 pid: 6679 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652335.540702:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 83 00000100:00100000:3.0:1788652335.540713:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f893100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+9:2347:x1875537603688192:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652335.540726:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652335.540747:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f8d2aa58/0x340ed74ef02a8493 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bed expref: 9 pid: 6679 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.540760:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f8d2aa58/0x340ed74ef02a8493 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bed expref: 9 pid: 6679 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.540817:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8d2aa58/0x340ed74ef02a8493 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bed expref: 9 pid: 6679 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.540833:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788652335.540837:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788652335.540844:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000025837c25/0x340ed74ef02a84b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.540880:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025837c25/0x340ed74ef02a84b6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.540906:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652335.540957:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f893100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2347:x1875537603688192:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 245us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652335.540965:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 83 00010000:00010000:2.0:1788652335.541024:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000025837c25/0x340ed74ef02a84b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.541034:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025837c25/0x340ed74ef02a84b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.541057:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000025837c25/0x340ed74ef02a84b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.541075:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025837c25/0x340ed74ef02a84b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.541084:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025837c25/0x340ed74ef02a84b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.541092:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e400 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652335.541097:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025837c25/0x340ed74ef02a84b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.541106:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025837c25/0x340ed74ef02a84b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.541291:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025837c25/0x340ed74ef02a84b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.541299:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025837c25/0x340ed74ef02a84b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652335.541357:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2349:x1875537603688064:12345-192.168.203.50@tcp:1:lhsmtool_posix.0 Request processed in 4660us (4888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652335.541366:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 70 00000100:00100000:1.0:1788652335.544762:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652335.544991:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603688448 00000100:00100000:2.0:1788652335.545002:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603688448 00000100:00100000:2.0:1788652335.545066:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 230 00000100:00100000:2.0:1788652335.545077:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+19:11594:x1875537603688448:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788652335.545333:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a84bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.545352:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a84bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.545364:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a84bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.545566:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a84c4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.545579:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11c00/0x340ed74ef02a8477 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bd8 expref: 20 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.545606:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a84c4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.545641:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11c00/0x340ed74ef02a8477 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bd8 expref: 20 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.545656:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11c00/0x340ed74ef02a8477 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bd8 expref: 20 pid: 11683 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652335.545670:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe81a53480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875537627788288:192.168.203.50@tcp:104: 00000100:00100000:2.0:1788652335.545823:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788652335.549600:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652335.549678:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603688576 00000100:00100000:3.0:1788652335.549687:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603688576 00010000:00010000:3.0:1788652335.549727:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11c00/0x340ed74ef02a8477 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bd8 expref: 21 pid: 11683 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652335.549767:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 84 00000100:00100000:3.0:1788652335.549807:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f893800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+21:2346:x1875537603688576:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652335.549820:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652335.549828:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11c00/0x340ed74ef02a8477 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bd8 expref: 21 pid: 11683 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.549842:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11c00/0x340ed74ef02a8477 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bd8 expref: 21 pid: 11683 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.549864:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cbe48888d00) 00010000:00010000:3.0:1788652335.549880:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a84c4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.549890:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a84c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.549913:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a84c4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.549934:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652335.549981:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f893800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+21:2346:x1875537603688576:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 177us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652335.549989:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 84 00010000:00010000:2.0:1788652335.550298:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11c00/0x340ed74ef02a8477 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bd8 expref: 20 pid: 11683 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652335.550323:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe81a53480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875537627788288:192.168.203.50@tcp:104: 00010000:00010000:2.0:1788652335.550345:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a84c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.550354:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a84c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.550360:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a84c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788652335.550533:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1788652335.550679:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1788652335.550722:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1788652335.550845:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe81a53480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5835:1875537627788416:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788652335.551079:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652335.551114:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652335.551210:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627788416 00000100:00100000:3.0:1788652335.551216:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627788416 00000100:00100000:3.0:1788652335.551258:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788652335.551267:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5835:x1875537627788416:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788652335.551338:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5835:x1875537627788416:12345-0@lo:1000:mdt00_000.0 Request processed in 72us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652335.551345:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788652335.551827:0:5835:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1788652335.551833:0:5835:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1788652335.551852:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cbe81a50700, transno 4294967321 00000100:00100000:2.0:1788652335.551920:0:5835:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cbe81a52300 x1875537627787648/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788652351 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652335.551931:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe81a53480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5835:1875537627788416:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788652335.552533:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788652335.552607:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe81a53480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5835:1875537627788544:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788652335.552646:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652335.552678:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788652335.553082:0:12399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627788544 00000100:00100000:1.0:1788652335.553090:0:12399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627788544 00000100:00100000:1.0:1788652335.553141:0:12399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788652335.553151:0:12399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5835:x1875537627788544:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788652335.553336:0:12399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5835:x1875537627788544:12345-0@lo:1000:mdt00_000.0 Request processed in 186us (688us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788652335.553344:0:12399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788652335.553616:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe81a53480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5835:1875537627788544:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788652335.553661:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a84c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.553670:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a84c4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.553677:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a84c4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.553684:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215f400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652335.553689:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a84c4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.553697:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a84c4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.553714:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cbe48888d00) 00010000:00010000:0.0:1788652335.553717:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788652335.553721:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a84c4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.553728:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a84c4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.553758:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a8407 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.553766:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a8407 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.553804:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a8407 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.553821:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e57a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652335.553824:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a8407 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.553830:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a8407 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.553839:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:0.0:1788652335.553841:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788652335.553848:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a840e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bbc expref: 23 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.553859:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a840e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bbc expref: 23 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.553879:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a840e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bbc expref: 23 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.553910:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a840e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bbc expref: 23 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652335.553923:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe513b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875537627788672:192.168.203.50@tcp:105: 00000100:00100000:0.0:1788652335.553988:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5128b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652335.559100:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652335.559231:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603688704 00000100:00100000:2.0:1788652335.559241:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603688704 00000100:00100000:2.0:1788652335.559298:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 61 00000100:00100000:2.0:1788652335.559320:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+24:11593:x1875537603688704:12345-192.168.203.50@tcp:49:lfs.0 00000100:00100000:2.0:1788652335.559449:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+24:11593:x1875537603688704:12345-192.168.203.50@tcp:49:lfs.0 Request processed in 141us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652335.559460:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 61 00000100:00100000:0.0:1788652335.560358:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe513b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5835:1875537627788672:192.168.203.50@tcp:105: 00010000:00010000:0.0:1788652335.560389:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a8407 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.560418:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e57a00/0x340ed74ef02a8407 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.560449:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10200/0x340ed74ef02a84cb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.560463:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10200/0x340ed74ef02a84cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.560474:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10200/0x340ed74ef02a84cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.560483:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10200/0x340ed74ef02a84cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.560489:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10200/0x340ed74ef02a84cb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.560494:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10200/0x340ed74ef02a84cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.560499:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7fd10200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652335.560503:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10200/0x340ed74ef02a84cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.560509:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10200/0x340ed74ef02a84cb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.560518:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:0.0:1788652335.560521:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652335.560524:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10200/0x340ed74ef02a84cb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.560538:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10200/0x340ed74ef02a84cb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.560549:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a84bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.560555:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a84bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.560561:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a84bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.560566:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215fa00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652335.560569:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a84bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.560575:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a84bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.560584:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:0.0:1788652335.560587:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788652335.560590:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a84bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.560595:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fa00/0x340ed74ef02a84bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652335.560858:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+23:11594:x1875537603688448:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 15781us (16102us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1788652335.560876:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 230 00000020:00080000:0.0:1788652335.560887:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788652335.565748:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652335.565810:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652335.565895:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603689216 00000100:00100000:3.0:1788652335.565905:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603689216 00000100:00100000:3.0:1788652335.565965:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 231 00000100:00100000:3.0:1788652335.565974:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+23:11593:x1875537603689216:12345-192.168.203.50@tcp:58:lfs.0 00000040:00080000:3.0:1788652335.566361:0:6701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788652335.566439:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+23:11593:x1875537603689216:12345-192.168.203.50@tcp:58:lfs.0 Request processed in 465us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652335.566448:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 231 00000100:00100000:2.0:1788652335.567331:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603688960 00000100:00100000:2.0:1788652335.567341:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603688960 00000100:00100000:2.0:1788652335.567388:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 62 00000100:00100000:2.0:1788652335.567398:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe47b4b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+23:11594:x1875537603688960:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788652335.568031:0:5838:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788652335.568844:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1788652335.569351:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a84d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.569370:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a84d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.569381:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a84d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.569390:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a84d2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.569396:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a84d2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.569403:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a84d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.569489:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788652335.569597:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe47b4b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+25:11594:x1875537603688960:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 2196us (3864us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788652335.569606:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 62 00000020:00080000:2.0:1788652335.569611:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1788652335.569874:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788652335.569879:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788652335.569935:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788652335.569943:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788652335.570055:0:11670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe513b4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1875537627788800:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788652335.570128:0:11670:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5128b840 going to sleep for 11 seconds 00010000:00010000:3.0:1788652335.574326:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652335.574341:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a84d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.574353:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e400 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:3.0:1788652335.574375:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a84d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.574386:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a84d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.574405:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cbe485acb00) 00010000:00010000:3.0:1788652335.574408:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788652335.574413:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a84d2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.574419:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e400/0x340ed74ef02a84d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.574962:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652335.574965:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652335.574967:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652335.575856:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652335.575983:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603689344 00000100:00100000:2.0:1788652335.575993:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603689344 00000100:00100000:2.0:1788652335.576051:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 232 00000100:00100000:2.0:1788652335.576070:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+26:11595:x1875537603689344:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788652335.576105:0:11683:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788652335.576589:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+26:11595:x1875537603689344:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 527us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652335.576598:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 232 00000100:00100000:0.0:1788652335.576927:0:11670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe513b4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1875537627788800:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788652335.584575:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652335.584663:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603689600 00000100:00100000:2.0:1788652335.584674:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603689600 00000100:00100000:2.0:1788652335.584754:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 233 00000100:00100000:2.0:1788652335.584765:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+25:11595:x1875537603689600:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788652335.584804:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652335.584824:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a84d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0bf4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.584935:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a84e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.584951:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a84e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.584962:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a84e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652335.584973:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788652335.585328:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f400/0x340ed74ef02a84d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bf4 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.585348:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a84e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bf4 expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652335.585356:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:2.0:1788652335.585359:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788652335.585363:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215e200, rc 0) 00000100:00100000:2.0:1788652335.585422:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+27:11595:x1875537603689600:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 660us (858us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788652335.585446:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 233 00000100:00100000:2.0:1788652335.589050:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652335.589262:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603689856 00000100:00100000:1.0:1788652335.589272:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603689856 00000100:00100000:1.0:1788652335.589362:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 234 00000100:00100000:1.0:1788652335.589372:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+27:11595:x1875537603689856:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788652335.589445:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a84ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652335.589462:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a84ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652335.589473:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a84ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652335.589654:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a84ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652335.589675:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a84ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652335.589682:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a84ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652335.589689:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652335.589693:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a84ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652335.589700:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a84ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652335.589712:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:1.0:1788652335.589715:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788652335.589721:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a84ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652335.589727:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a84ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652335.590024:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+28:11595:x1875537603689856:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 652us (985us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1788652335.590033:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 234 00000040:00080000:0.0:1788652335.590737:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788652335.590744:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788652335.591574:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788652335.591586:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788652335.599629:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652335.600056:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603690112 00000100:00100000:3.0:1788652335.600127:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603690112 00000100:00100000:2.0:1788652335.600532:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 63 00000100:00100000:2.0:1788652335.600543:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+28:11595:x1875537603690112:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788652335.600802:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+29:11595:x1875537603690112:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 230us (1152us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788652335.600811:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 63 00000100:00100000:3.0:1788652335.608419:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652335.608517:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603690240 00000100:00100000:0.0:1788652335.608528:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603690240 00000100:00100000:0.0:1788652335.608589:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 235 00000100:00100000:0.0:1788652335.608600:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+29:11597:x1875537603690240:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1788652335.608624:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652335.608646:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10200/0x340ed74ef02a84f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0bfb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.608710:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11400/0x340ed74ef02a84fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.608726:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11400/0x340ed74ef02a84fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.608757:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11400/0x340ed74ef02a84fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.608806:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11200/0x340ed74ef02a8503 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.608814:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11200/0x340ed74ef02a8503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.608821:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11200/0x340ed74ef02a8503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.609037:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10400/0x340ed74ef02a850a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.609049:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a83f9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bb5 expref: 30 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.609059:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10400/0x340ed74ef02a850a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.609093:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a83f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bb5 expref: 30 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.609108:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a83f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bb5 expref: 30 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652335.609633:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe513b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875537627788928:192.168.203.50@tcp:104: 00000100:00100000:0.0:1788652335.609739:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5128b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788652335.614925:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652335.615081:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603690496 00000100:00100000:1.0:1788652335.615091:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603690496 00000100:00100000:1.0:1788652335.615215:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 64 00000100:00100000:1.0:1788652335.615226:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+31:5586:x1875537603690496:12345-192.168.203.50@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788652335.615658:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe513b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5836:1875537627788928:192.168.203.50@tcp:104: 00010000:00010000:0.0:1788652335.615686:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10400/0x340ed74ef02a850a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652335.616248:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+32:5586:x1875537603690496:12345-192.168.203.50@tcp:35:ldlm_bl.0 Request processed in 1021us (1331us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788652335.616273:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 64 00000100:00100000:2.0:1788652335.622150:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652335.622403:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603690624 00000100:00100000:3.0:1788652335.622413:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603690624 00010000:00010000:3.0:1788652335.622457:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a83f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bb5 expref: 32 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652335.622555:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 85 00000100:00100000:3.0:1788652335.622567:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81a53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+32:2346:x1875537603690624:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652335.622581:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652335.622588:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a83f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bb5 expref: 32 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.622620:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a83f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bb5 expref: 32 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.622642:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56800/0x340ed74ef02a83f9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bb5 expref: 32 pid: 5835 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.622659:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:3.0:1788652335.622665:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10400/0x340ed74ef02a850a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.622674:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10400/0x340ed74ef02a850a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.622681:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10400/0x340ed74ef02a850a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652335.622716:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652335.622805:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81a53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+31:2346:x1875537603690624:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 240us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652335.622813:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 85 00010000:00010000:0.0:1788652335.625410:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10400/0x340ed74ef02a850a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.625427:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10400/0x340ed74ef02a850a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652335.625475:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788652335.625480:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788652335.625501:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10400/0x340ed74ef02a850a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.625517:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10400/0x340ed74ef02a850a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.625527:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11400/0x340ed74ef02a84fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.625534:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11400/0x340ed74ef02a84fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.625552:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11400/0x340ed74ef02a84fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.625558:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7fd11400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652335.625562:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11400/0x340ed74ef02a84fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.625569:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11400/0x340ed74ef02a84fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.625602:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:0.0:1788652335.625606:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652335.625612:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11400/0x340ed74ef02a84fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.625618:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11400/0x340ed74ef02a84fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.625633:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11200/0x340ed74ef02a8503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.625639:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11200/0x340ed74ef02a8503 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.625643:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11200/0x340ed74ef02a8503 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.625647:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7fd11200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652335.625650:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11200/0x340ed74ef02a8503 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.625655:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11200/0x340ed74ef02a8503 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.625661:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cbe48888d00) 00010000:00010000:0.0:1788652335.625663:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652335.625665:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11200/0x340ed74ef02a8503 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.625670:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11200/0x340ed74ef02a8503 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.625725:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10200/0x340ed74ef02a84f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bfb expref: 31 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.625739:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10400/0x340ed74ef02a850a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bfb expref: 30 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652335.625746:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:0.0:1788652335.625747:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788652335.625749:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7fd10400, rc 0) 00000100:00100000:0.0:1788652335.625859:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+30:11597:x1875537603690240:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 17260us (17448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652335.625869:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 235 00000040:00080000:1.0:1788652336.377126:0:12495:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788652336.377136:0:12495:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788652336.377187:0:12495:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788652336.377194:0:12495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788652336.398182:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652336.573121:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652336.573178:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603690880 00000100:00100000:1.0:1788652336.573187:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603690880 00000100:00100000:1.0:1788652336.573262:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 236 00000100:00100000:1.0:1788652336.573272:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+30:11620:x1875537603690880:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1788652336.573294:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652336.573328:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a8511 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0c02 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652336.573426:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9c00/0x340ed74ef02a8518 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652336.573441:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9c00/0x340ed74ef02a8518 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652336.573452:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9c00/0x340ed74ef02a8518 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652336.573464:0:6701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788652336.573600:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8800/0x340ed74ef02a8511 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c02 expref: 33 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652336.573618:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9c00/0x340ed74ef02a8518 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c02 expref: 32 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652336.573644:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:1.0:1788652336.573647:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788652336.573651:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c9c00, rc 0) 00000100:00100000:1.0:1788652336.573754:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+32:11620:x1875537603690880:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 483us (643us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1788652336.573761:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 236 00000100:00080000:3.0:1788652336.574694:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652336.577727:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652336.577847:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603691008 00000100:00100000:1.0:1788652336.577858:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603691008 00000100:00100000:1.0:1788652336.577914:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 237 00000100:00100000:1.0:1788652336.577925:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+32:11620:x1875537603691008:12345-192.168.203.50@tcp:54:lfs.0 00010000:00010000:1.0:1788652336.578001:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a8526 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652336.578019:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a8526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652336.578031:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a8526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652336.578057:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a8526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652336.578064:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a8526 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652336.578071:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a8526 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652336.578077:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c8a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652336.578104:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a8526 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652336.578113:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a8526 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652336.578126:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:1.0:1788652336.578129:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788652336.578135:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a8526 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652336.578141:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8a00/0x340ed74ef02a8526 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652336.578218:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+32:11620:x1875537603691008:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 294us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652336.578226:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 237 00000100:00100000:0.0:1788652336.669196:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652336.669287:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603691136 00000100:00100000:1.0:1788652336.669298:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603691136 00000100:00100000:1.0:1788652336.669368:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 71 00000100:00100000:1.0:1788652336.669378:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2347:x1875537603691136:12345-192.168.203.50@tcp:101:cat.0 00010000:00010000:1.0:1788652336.669395:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652336.669417:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033527c44/0x340ed74ef02a852d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0c09 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788652336.669457:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9cab2d, atime: 0x6a9cab2d, ctime: 0x6a9cab2d, blocks: 0xb 00010000:00010000:1.0:1788652336.669480:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=353s v=(0 0) 00010000:00010000:1.0:1788652336.669485:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652336.669558:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033527c44/0x340ed74ef02a852d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c09 expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652336.669592:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000033527c44/0x340ed74ef02a852d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c09 expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652336.669604:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c8a00, rc 0) 00000100:00100000:1.0:1788652336.669654:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2347:x1875537603691136:12345-192.168.203.50@tcp:101:cat.0 Request processed in 278us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652336.669660:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 71 00000100:00100000:2.0:1788652336.673802:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652336.674022:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603691264 00000100:00100000:0.0:1788652336.674032:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603691264 00002000:00100000:0.0:1788652336.674139:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8cbe81a51500 x1875537603691264/t0(0) o3->20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp:722/0 lens 488/0 e 0 to 0 dl 1788652347 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788652336.674151:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe81a51500 with x1875537603691264 ext(0->4095) 00002000:00010000:0.0:1788652336.674157:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbe81a51500 00000100:00100000:0.0:1788652336.674182:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:0.0:1788652336.674190:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2348:x1875537603691264:12345-192.168.203.50@tcp:3:cat.0 00000100:00100000:0.0:1788652336.674399:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2348:x1875537603691264:12345-192.168.203.50@tcp:3:cat.0 Request processed in 209us (631us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788652336.674407:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 7 00002000:00100000:0.0:1788652336.674418:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8cbe81a51500 x1875537603691264/t0(0) o3->20ec7f44-aadf-40d6-8a9c-d109a8b21d8c@192.168.203.50@tcp:722/0 lens 488/4536 e 0 to 0 dl 1788652347 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788652336.674427:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cbe81a51500 with x1875537603691264 ext(0->4095) 00002000:00010000:0.0:1788652336.674430:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cbe81a51500 00010000:00010000:1.0:1788652337.416034:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652337.801344:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627789440:0@lo:400:kworker.0 00000100:00100000:2.0:1788652337.801349:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875537627789312:0@lo:400:kworker.0 00000100:00100000:1.0:1788652337.801435:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627789056:0@lo:400:kworker.0 00000100:00100000:2.0:1788652337.801977:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652337.802196:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788652337.802214:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627789184:0@lo:400:kworker.0 00000100:00100000:2.0:1788652337.802247:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652337.802338:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627789696:0@lo:400:kworker.0 00000100:00100000:2.0:1788652337.802365:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652337.802617:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652337.802649:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875537627789568:0@lo:400:kworker.0 00000100:00100000:1.0:1788652337.802673:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652337.804764:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652337.805340:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627789312 00000100:00100000:1.0:1788652337.805342:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627789056 00000100:00100000:3.0:1788652337.805350:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627789312 00000100:00100000:1.0:1788652337.805350:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627789056 00000100:00100000:1.0:1788652337.805401:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788652337.805407:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627789184 00000100:00100000:2.0:1788652337.805414:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627789184 00000100:00100000:1.0:1788652337.805414:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+19:3306:x1875537627789056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652337.805492:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f811a652-691e-4a40-b660-977a4758dd08+19:3306:x1875537627789056:12345-0@lo:400:kworker.0 Request processed in 78us (2871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652337.805500:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788652337.806496:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627789056:0@lo:400:kworker.0 00000100:00100000:0.0:1788652337.806709:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627789568 00000100:00100000:0.0:1788652337.806715:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627789568 00000100:00100000:3.0:1788652337.806735:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788652337.806749:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875537627789312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652337.806758:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788652337.806768:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627789184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652337.806823:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788652337.806830:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875537627789312:12345-0@lo:400:kworker.0 Request processed in 85us (4967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652337.806835:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875537627789568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652337.806845:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:3.0:1788652337.806882:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788652337.806883:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875537627789568:12345-0@lo:400:kworker.0 Request processed in 51us (4207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652337.806900:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788652337.807085:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627789184:12345-0@lo:400:kworker.0 Request processed in 318us (4837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652337.807091:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788652337.810109:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875537627789568:0@lo:400:kworker.0 00000100:00100000:2.0:1788652337.813742:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627789696 00000100:00100000:2.0:1788652337.813758:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627789696 00000100:00100000:2.0:1788652337.813847:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627789440 00000100:00100000:2.0:1788652337.813851:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627789440 00000100:00100000:2.0:1788652337.813892:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788652337.813901:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3304:x1875537627789696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652337.813988:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3304:x1875537627789696:12345-0@lo:400:kworker.0 Request processed in 87us (11621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652337.813994:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788652337.814010:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788652337.814018:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1875537627789440:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788652337.814142:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788652337.814146:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788652337.815027:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1875537627789440:12345-0@lo:400:kworker.0 Request processed in 1006us (10270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652337.815111:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788652337.815967:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627789184:0@lo:400:kworker.0 00000100:00100000:2.0:1788652337.815985:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627789696:0@lo:400:kworker.0 00000100:00100000:2.0:1788652337.815996:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875537627789312:0@lo:400:kworker.0 00000100:00100000:0.0:1788652337.816989:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627789440:0@lo:400:kworker.0 00000100:00100000:2.0:1788652337.843138:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652337.843174:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652337.843196:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652337.843225:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652337.843250:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652337.843279:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603691392 00000100:00100000:2.0:1788652337.843289:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603691392 00000100:00100000:2.0:1788652337.843343:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 296 00000100:00100000:2.0:1788652337.843353:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2347:x1875537603691392:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652337.843418:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2347:x1875537603691392:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 65us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652337.843426:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 296 00000100:00100000:2.0:1788652337.843469:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603691648 00000100:00100000:2.0:1788652337.843473:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603691648 00000100:00100000:2.0:1788652337.843516:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603691776 00000100:00100000:2.0:1788652337.843519:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603691776 00000100:00100000:2.0:1788652337.843540:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 91 00000100:00100000:2.0:1788652337.843548:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2347:x1875537603691648:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652337.843588:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+8:2347:x1875537603691648:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 41us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652337.843594:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 91 00000100:00100000:2.0:1788652337.843605:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 92 00000100:00100000:2.0:1788652337.843610:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2347:x1875537603691776:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652337.843629:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2347:x1875537603691776:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 19us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652337.843634:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 92 00000100:00100000:1.0:1788652337.844164:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603691904 00000100:00100000:1.0:1788652337.844170:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603691904 00000100:00100000:1.0:1788652337.844205:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603691520 00000100:00100000:1.0:1788652337.844220:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603691520 00000100:00100000:1.0:1788652337.844243:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 150 00000100:00100000:1.0:1788652337.844251:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2347:x1875537603691904:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652337.844303:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2347:x1875537603691904:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 43us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652337.844310:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 150 00000100:00100000:1.0:1788652337.844323:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 151 00000100:00100000:1.0:1788652337.844329:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+32:2347:x1875537603691520:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652337.844353:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+32:2347:x1875537603691520:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 24us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652337.844359:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 151 00000100:00080000:3.0:1788652337.844663:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788652337.844668:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788652337.844671:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788652337.898724:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1788652337.898751:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1788652337.898758:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:3.0:1788652338.312576:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788652338.312600:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627789824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788652338.312986:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652338.314677:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627789824 00000100:00100000:2.0:1788652338.314693:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627789824 00000100:00100000:2.0:1788652338.315005:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788652338.315016:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627789824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788652338.315053:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788652338.316659:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627789824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1637us (3665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652338.316698:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788652338.316863:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788652338.316869:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cbe7f2bed80, transno 4294967307 00000004:00080000:3.0:1788652338.316903:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1788652338.316965:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cbe81a50a80, transno 4294967310 00000100:00100000:3.0:1788652338.316982:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627789824:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788652338.440761:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652339.348629:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788652339.348652:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f8d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627789952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788652339.348732:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652339.348844:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627789952 00000100:00100000:3.0:1788652339.348852:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627789952 00000100:00100000:3.0:1788652339.348907:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788652339.348916:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875537627789952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788652339.348948:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652339.348993:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875537627789952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652339.349000:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1788652339.349433:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788652339.349472:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f8d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627789952:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788652339.464980:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652340.488196:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788652340.943028:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:1.0:1788652340.943047:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1788652340.943055:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:2.0:1788652340.948507:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1788652340.948541:0:5857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cbe7fcbbcc0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788652340.948546:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbe42e46700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cbe7fcbb840 00000020:00080000:2.0:1788652340.948550:0:5857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cbe42e46a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cbe82053000 00000020:00080000:2.0:1788652340.948590:0:5857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1788652340.948650:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788652340.948882:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1788652341.440606:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652341.442565:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603692032 00000100:00100000:0.0:1788652341.442579:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603692032 00000100:00100000:0.0:1788652341.442665:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 238 00000100:00100000:0.0:1788652341.442676:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+19:11282:x1875537603692032:12345-192.168.203.50@tcp:60:lhsmtool_posix.0 00000100:00080000:3.0:1788652341.442733:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788652341.442827:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+19:11282:x1875537603692032:12345-192.168.203.50@tcp:60:lhsmtool_posix.0 Request processed in 144us (2221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652341.442837:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 238 00000100:00100000:1.0:1788652341.456711:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652341.456809:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603692288 00000100:00100000:2.0:1788652341.456820:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603692288 00000100:00100000:2.0:1788652341.456890:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 65 00000100:00100000:2.0:1788652341.456902:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+19:11282:x1875537603692288:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788652341.457250:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+20:11282:x1875537603692288:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 349us (547us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788652341.457258:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 65 00010000:00010000:0.0:1788652341.512477:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788652341.768147:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788652341.768156:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788652341.768188:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788652341.768195:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788652341.773147:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652341.773248:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603692416 00000100:00100000:3.0:1788652341.773258:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603692416 00000100:00100000:3.0:1788652341.773380:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 239 00000100:00100000:3.0:1788652341.773391:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:12073:x1875537603692416:12345-192.168.203.50@tcp:101:lsof.0 00010000:00010000:3.0:1788652341.773412:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652341.773433:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a8534 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0c10 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788652341.773492:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788652341.773496:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a853b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652341.773509:0:6701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a853b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652341.773520:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a853b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652341.773553:0:6701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788652341.773557:0:6701:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788652341.773578:0:6701:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a853b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652341.773602:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4c00/0x340ed74ef02a8534 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c10 expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652341.773620:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a853b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c10 expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652341.773645:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe7fde3500) 00010000:00010000:3.0:1788652341.773649:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788652341.773652:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e4a00, rc 0) 00000100:00100000:3.0:1788652341.773745:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3eb94160-5684-49f0-9e45-fbf338e18f8d+6:12073:x1875537603692416:12345-192.168.203.50@tcp:101:lsof.0 Request processed in 355us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652341.773752:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 239 00010000:00010000:0.0:1788652342.536030:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652342.920501:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627790464:0@lo:400:kworker.0 00000100:00100000:2.0:1788652342.920522:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875537627790336:0@lo:400:kworker.0 00000100:00100000:3.0:1788652342.920590:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627790080:0@lo:400:kworker.0 00000100:00100000:1.0:1788652342.920608:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627790208:0@lo:400:kworker.0 00000100:00100000:2.0:1788652342.920674:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652342.920751:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627790336 00000100:00100000:2.0:1788652342.920759:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627790336 00000100:00100000:2.0:1788652342.920829:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788652342.920838:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875537627790336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652342.920888:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875537627790336:12345-0@lo:400:kworker.0 Request processed in 51us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652342.920895:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:2.0:1788652342.920914:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652342.920943:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875537627790336:0@lo:400:kworker.0 00000100:00100000:0.0:1788652342.922879:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652342.922937:0:8297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627790464 00000100:00100000:2.0:1788652342.922945:0:8297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627790464 00000100:00100000:2.0:1788652342.922998:0:8297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788652342.923007:0:8297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627790464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652342.923060:0:8297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627790464:12345-0@lo:400:kworker.0 Request processed in 55us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652342.923080:0:8297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1788652342.923120:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788652342.923169:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1788652342.923175:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cbe81a52300, transno 4294967322 00000004:00080000:0.0:1788652342.923186:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1788652342.923208:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627790464:0@lo:400:kworker.0 00000100:00100000:3.0:1788652342.923574:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652342.923645:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875537627790592:0@lo:400:kworker.0 00000100:00100000:3.0:1788652342.923803:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652342.923901:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627790592 00000100:00100000:3.0:1788652342.923906:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627790592 00000100:00100000:3.0:1788652342.924142:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788652342.924151:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875537627790592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652342.924192:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875537627790592:12345-0@lo:400:kworker.0 Request processed in 43us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652342.924199:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:3.0:1788652342.924221:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652342.924243:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875537627790592:0@lo:400:kworker.0 00000100:00100000:0.0:1788652342.924418:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627790080 00000100:00100000:0.0:1788652342.924423:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627790080 00000100:00100000:0.0:1788652342.924571:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788652342.924579:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:3306:x1875537627790080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652342.924620:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:3306:x1875537627790080:12345-0@lo:400:kworker.0 Request processed in 43us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652342.924626:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788652342.924692:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627790080:0@lo:400:kworker.0 00000100:00100000:1.0:1788652342.927701:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652342.927868:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627790720:0@lo:400:kworker.0 00000100:00100000:1.0:1788652342.927911:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652342.929884:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627790208 00000100:00100000:3.0:1788652342.929897:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627790208 00000100:00100000:3.0:1788652342.929967:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788652342.929979:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627790208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652342.930070:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627790208:12345-0@lo:400:kworker.0 Request processed in 94us (2376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652342.930079:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788652342.930103:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627790720 00000100:00100000:2.0:1788652342.930110:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627790720 00000100:00100000:2.0:1788652342.930171:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788652342.930179:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627790720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652342.930218:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627790720:12345-0@lo:400:kworker.0 Request processed in 41us (2307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652342.930225:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788652342.930374:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627790208:0@lo:400:kworker.0 00000100:00100000:1.0:1788652342.930387:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627790720:0@lo:400:kworker.0 00000100:00080000:3.0:1788652342.931983:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788652342.974230:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652342.974368:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652342.974405:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652342.974436:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652342.974459:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652342.974505:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603692800 00000100:00100000:1.0:1788652342.974515:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603692800 00000100:00100000:0.0:1788652342.974515:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603693056 00000100:00100000:0.0:1788652342.974524:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603693056 00000100:00100000:1.0:1788652342.974571:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603692928 00000100:00100000:1.0:1788652342.974575:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603692928 00000100:00100000:1.0:1788652342.974598:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 95 00000100:00100000:1.0:1788652342.974608:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2346:x1875537603692800:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1788652342.974630:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603692672 00000100:00100000:0.0:1788652342.974635:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603692672 00000100:00100000:0.0:1788652342.974661:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 155 00000100:00100000:0.0:1788652342.974669:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3eb94160-5684-49f0-9e45-fbf338e18f8d+6:2346:x1875537603693056:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652342.974685:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2346:x1875537603692800:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 77us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652342.974693:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 95 00000100:00100000:0.0:1788652342.974712:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3eb94160-5684-49f0-9e45-fbf338e18f8d+6:2346:x1875537603693056:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 41us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652342.974715:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 96 00000100:00100000:1.0:1788652342.974723:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2346:x1875537603692928:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1788652342.974737:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 155 00000100:00100000:1.0:1788652342.974756:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2346:x1875537603692928:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 32us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652342.974758:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 156 00000100:00100000:1.0:1788652342.974793:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 96 00000100:00100000:0.0:1788652342.974838:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+20:2346:x1875537603692672:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1788652342.974879:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+20:2346:x1875537603692672:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 111us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652342.974887:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 156 00000100:00100000:2.0:1788652342.975120:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603692544 00000100:00100000:2.0:1788652342.975125:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603692544 00000100:00100000:2.0:1788652342.975165:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 298 00000100:00100000:2.0:1788652342.975172:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2346:x1875537603692544:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652342.975210:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2346:x1875537603692544:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 38us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652342.975215:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 298 00000100:00080000:3.0:1788652342.975576:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788652342.975582:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788652343.432340:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627790848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788652343.432411:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652343.432548:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627790848 00000100:00100000:3.0:1788652343.432557:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627790848 00000100:00100000:3.0:1788652343.432612:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788652343.432621:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627790848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788652343.432654:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652343.432711:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627790848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652343.432718:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788652343.432870:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627790848:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788652343.560077:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652344.458288:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f8d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627790976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788652344.458356:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652344.458431:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627790976 00000100:00100000:3.0:1788652344.458437:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627790976 00000100:00100000:3.0:1788652344.458490:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788652344.458499:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627790976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788652344.458532:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652344.458573:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627790976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652344.458579:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1788652344.458600:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788652344.458635:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f8d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627790976:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788652344.583991:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788652344.752171:0:12697:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 19:52:22 (1788652342) 00010000:00010000:0.0:1788652345.610099:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788652346.037836:0:5857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:3.0:1788652346.037872:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1788652346.037884:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788652346.037893:0:5868:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1788652346.631891:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652347.660491:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652348.040871:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627791232:0@lo:400:kworker.0 00000100:00100000:1.0:1788652348.040943:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652348.041018:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe81a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627791744:0@lo:400:kworker.0 00000100:00100000:1.0:1788652348.041045:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652348.041089:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788652348.041094:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f891f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627791360:0@lo:400:kworker.0 00000100:00100000:1.0:1788652348.041113:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652348.041139:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627791232 00000100:00100000:1.0:1788652348.041146:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627791232 00000100:00100000:1.0:1788652348.041299:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627791360 00000100:00100000:0.0:1788652348.041302:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627791104:0@lo:400:kworker.0 00000100:00100000:1.0:1788652348.041303:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627791360 00000100:00100000:1.0:1788652348.041331:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788652348.041335:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652348.041340:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627791232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652348.041357:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe81a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875537627791616:0@lo:400:kworker.0 00000100:00100000:0.0:1788652348.041379:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652348.041389:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627791232:12345-0@lo:400:kworker.0 Request processed in 50us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652348.041393:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788652348.041395:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788652348.041397:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627791488:0@lo:400:kworker.0 00000100:00100000:1.0:1788652348.041409:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627791616 00000100:00100000:1.0:1788652348.041412:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627791616 00000100:00100000:0.0:1788652348.041416:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652348.041428:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788652348.041434:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627791360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652348.041443:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788652348.041449:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875537627791616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652348.041460:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627791360:12345-0@lo:400:kworker.0 Request processed in 28us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652348.041466:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788652348.041483:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627791744 00000100:00100000:1.0:1788652348.041487:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627791744 00000100:00100000:0.0:1788652348.041487:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875537627791616:12345-0@lo:400:kworker.0 Request processed in 38us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652348.041492:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788652348.041699:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627791104 00000100:00100000:0.0:1788652348.041703:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627791104 00000100:00100000:0.0:1788652348.041834:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788652348.041843:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:3306:x1875537627791104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652348.041877:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f811a652-691e-4a40-b660-977a4758dd08+19:3306:x1875537627791104:12345-0@lo:400:kworker.0 Request processed in 36us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652348.041883:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788652348.041910:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627791488 00000100:00100000:0.0:1788652348.041914:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627791488 00000100:00100000:0.0:1788652348.041940:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788652348.041947:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627791744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652348.041974:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627791744:12345-0@lo:400:kworker.0 Request processed in 28us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652348.041979:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788652348.041989:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788652348.042040:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627791488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652348.042070:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627791488:12345-0@lo:400:kworker.0 Request processed in 32us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652348.042076:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1788652348.042092:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788652348.042096:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788652348.042098:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788652348.042111:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627791488:0@lo:400:kworker.0 00000100:00100000:0.0:1788652348.042121:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627791104:0@lo:400:kworker.0 00000100:00100000:0.0:1788652348.042130:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe81a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875537627791616:0@lo:400:kworker.0 00000100:00100000:3.0:1788652348.042156:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652348.042183:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603693312 00000100:00100000:3.0:1788652348.042187:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603693312 00000100:00100000:3.0:1788652348.042219:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 66 00000100:00100000:3.0:1788652348.042235:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+19:12295:x1875537603693312:12345-192.168.203.50@tcp:35:umount.0 00000100:00100000:0.0:1788652348.042272:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f891f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627791360:0@lo:400:kworker.0 00000100:00100000:0.0:1788652348.042282:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627791232:0@lo:400:kworker.0 00000100:00100000:0.0:1788652348.042291:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe81a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627791744:0@lo:400:kworker.0 00000100:00100000:3.0:1788652348.042561:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+20:12295:x1875537603693312:12345-192.168.203.50@tcp:35:umount.0 Request processed in 334us (405us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788652348.042568:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 66 00000100:00080000:3.0:1788652348.042583:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788652348.059215:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652348.059353:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603693568 00000100:00100000:0.0:1788652348.059363:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603693568 00000100:00100000:0.0:1788652348.059428:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 67 00000100:00100000:0.0:1788652348.059438:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+20:12295:x1875537603693568:12345-192.168.203.50@tcp:35:umount.0 00000100:00100000:0.0:1788652348.060110:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+21:12295:x1875537603693568:12345-192.168.203.50@tcp:35:umount.0 Request processed in 671us (903us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788652348.060121:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 67 00000100:00100000:3.0:1788652348.063669:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652348.063968:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603693824 00000100:00100000:2.0:1788652348.063978:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603693824 00000100:00100000:2.0:1788652348.064040:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 68 00000100:00100000:2.0:1788652348.064051:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe47b4b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+21:12295:x1875537603693824:12345-192.168.203.50@tcp:35:umount.0 00000100:00100000:2.0:1788652348.065393:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe47b4b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+22:12295:x1875537603693824:12345-192.168.203.50@tcp:35:umount.0 Request processed in 1338us (1726us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788652348.065404:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 68 00000100:00100000:1.0:1788652348.071570:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652348.073471:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603694080 00000100:00100000:0.0:1788652348.073683:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603694080 00000100:00100000:0.0:1788652348.074129:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 69 00000100:00100000:0.0:1788652348.074142:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+22:12295:x1875537603694080:12345-192.168.203.50@tcp:35:umount.0 00000100:00100000:0.0:1788652348.075116:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+23:12295:x1875537603694080:12345-192.168.203.50@tcp:35:umount.0 Request processed in 972us (3550us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788652348.075126:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 69 00000100:00100000:1.0:1788652348.083679:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652348.083878:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603694336 00000100:00100000:3.0:1788652348.083888:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603694336 00000100:00100000:3.0:1788652348.083956:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:3.0:1788652348.083966:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe494aec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2347:x1875537603694336:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652348.083981:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652348.084000:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe7a0e5e00/0x340ed74ef02a7519 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0763 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652348.084017:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652348.084075:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe494aec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+12:2347:x1875537603694336:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 110us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652348.084082:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:3.0:1788652348.087927:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652348.087969:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652348.088000:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652348.088035:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652348.088064:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652348.088089:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603694208 00000100:00100000:3.0:1788652348.088091:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603694848 00000100:00100000:3.0:1788652348.088101:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603694848 00000100:00100000:2.0:1788652348.088101:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603694208 00000100:00100000:2.0:1788652348.088154:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603694976 00000100:00100000:2.0:1788652348.088168:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603694976 00000100:00100000:2.0:1788652348.088192:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:2.0:1788652348.088203:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+13:2349:x1875537603694208:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652348.088217:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652348.088250:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe49e57e00/0x340ed74ef02a75b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f079b expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652348.088267:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652348.088289:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603694464 00000100:00100000:1.0:1788652348.088295:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603694464 00000100:00100000:2.0:1788652348.088318:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+12:2349:x1875537603694208:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 117us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652348.088328:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 99 00000100:00100000:2.0:1788652348.088330:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:1.0:1788652348.088339:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2349:x1875537603694464:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652348.088353:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00100000:2.0:1788652348.088362:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+11:2346:x1875537603694976:12345-192.168.203.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788652348.088388:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2349:x1875537603694464:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 51us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652348.088396:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 99 00000100:00100000:1.0:1788652348.088411:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 72 00000100:00100000:1.0:1788652348.088417:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2345:x1875537603694848:12345-192.168.203.50@tcp:9:umount.0 00000020:00000080:1.0:1788652348.088435:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a788b 00000100:00080000:1.0:1788652348.088442:0:6678:0:(import.c:65:import_set_state_nolock()) ffff8cbe7a481800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788652348.088479:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788652348.088812:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+2:2345:x1875537603694848:12345-192.168.203.50@tcp:9:umount.0 Request processed in 393us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652348.088820:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 72 00010000:00010000:1.0:1788652348.088839:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652348.088851:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603694720 00000100:00100000:1.0:1788652348.088854:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603694720 00000100:00100000:1.0:1788652348.088885:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 160 00000100:00100000:1.0:1788652348.088893:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe513b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3eb94160-5684-49f0-9e45-fbf338e18f8d+6:2349:x1875537603694720:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:1.0:1788652348.088920:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe513b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3eb94160-5684-49f0-9e45-fbf338e18f8d+6:2349:x1875537603694720:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 29us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652348.088928:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 160 00000100:00080000:1.0:1788652348.089085:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788652348.089091:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788652348.089094:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788652348.089106:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652348.089123:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe40030a00/0x340ed74ef02a77c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0866 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652348.089137:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652348.089166:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:2346:x1875537603694976:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 806us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652348.089174:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00100000:3.0:1788652348.094141:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652348.094335:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603695360 00000100:00100000:1.0:1788652348.094345:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603695360 00000100:00100000:1.0:1788652348.094405:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 73 00000100:00100000:1.0:1788652348.094416:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2345:x1875537603695360:12345-192.168.203.50@tcp:9:umount.0 00000020:00000080:1.0:1788652348.094459:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a7af3 00000020:00010000:1.0:1788652348.094467:0:6678:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cbe48683000: total 0 00000100:00080000:1.0:1788652348.094472:0:6678:0:(import.c:65:import_set_state_nolock()) ffff8cbe48687000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788652348.094519:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788652348.094840:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+5:2345:x1875537603695360:12345-192.168.203.50@tcp:9:umount.0 Request processed in 425us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652348.094848:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 73 00000020:00010000:0.0:1788652348.095553:0:5824:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cbe48683000: total 0 00010000:00010000:0.0:1788652348.095592:0:5824:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cbe48683000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788652348.095717:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a58c37e8/0x340ed74ef02a7e8f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a3b expref: 4 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652348.096082:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033527c44/0x340ed74ef02a852d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c09 expref: 3 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652348.096118:0:5824:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cbe48683000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788652348.096134:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652348.096136:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652348.096138:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652348.114463:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652348.114607:0:11683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603696384 00000100:00100000:0.0:1788652348.114618:0:11683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603696384 00000100:00100000:0.0:1788652348.114683:0:11683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 240 00000100:00100000:0.0:1788652348.114694:0:11683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe819e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+23:2345:x1875537603696384:12345-192.168.203.50@tcp:39:umount.0 00000020:00000080:0.0:1788652348.114728:0:11683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a7527 00000020:00010000:0.0:1788652348.114747:0:11683:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cbe747a9800: total 0 00000100:00080000:0.0:1788652348.114752:0:11683:0:(import.c:65:import_set_state_nolock()) ffff8cbe747a9000 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1788652348.114866:0:5823:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cbe747a9800: total 0 00010000:00010000:1.0:1788652348.114871:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652348.114921:0:5823:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cbe747a9800, canceled 0 locks, left on hash table 14. 00010000:00010000:1.0:1788652348.114956:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:1.0:1788652348.114960:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788652348.114969:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215f800/0x340ed74ef02a7861 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0890 expref: 22 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1788652348.115071:0:11683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00010000:00010000:1.0:1788652348.115317:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:1.0:1788652348.115320:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788652348.115326:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe49e56e00/0x340ed74ef02a840e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bbc expref: 21 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652348.115339:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:1.0:1788652348.115342:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788652348.115346:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10400/0x340ed74ef02a850a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bfb expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652348.115359:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:1.0:1788652348.115362:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788652348.115381:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8000/0x340ed74ef02a7f0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a5e expref: 19 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652348.115396:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:1.0:1788652348.115399:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788652348.115403:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215fc00/0x340ed74ef02a7d70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f09ee expref: 18 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652348.115415:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbe7fde3200) 00010000:00010000:1.0:1788652348.115417:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652348.115421:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a780d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f087b expref: 17 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652348.115438:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:1.0:1788652348.115440:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788652348.115444:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151a800/0x340ed74ef02a7e50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a26 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652348.115456:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:1.0:1788652348.115458:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788652348.115462:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe8215e200/0x340ed74ef02a84e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0bf4 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652348.115472:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe7fde3500) 00010000:00010000:1.0:1788652348.115474:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788652348.115477:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a7ef1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a57 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652348.115489:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cbe7fde3300) 00010000:00010000:1.0:1788652348.115497:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788652348.115502:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9c00/0x340ed74ef02a8518 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c02 expref: 13 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652348.115517:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cbe485ac700) 00010000:00010000:1.0:1788652348.115520:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788652348.115524:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe4151ac00/0x340ed74ef02a7b4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0962 expref: 12 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652348.115537:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cbe48da0300) 00010000:00010000:1.0:1788652348.115540:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788652348.115543:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe52924400/0x340ed74ef02a77f1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0874 expref: 11 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652348.115557:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cbe485ac400) 00010000:00010000:1.0:1788652348.115560:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788652348.115563:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4e00/0x340ed74ef02a7e7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0a34 expref: 10 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652348.115578:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cbe48da0b00) 00010000:00010000:1.0:1788652348.115580:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788652348.115584:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a81ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0b30 expref: 9 pid: 11683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652348.115598:0:5823:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cbe747a9800, canceled 14 locks, left on hash table 0. 00010000:00010000:1.0:1788652348.115626:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652348.115628:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652348.115630:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652348.116589:0:11683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe819e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20ec7f44-aadf-40d6-8a9c-d109a8b21d8c+7:2345:x1875537603696384:12345-192.168.203.50@tcp:39:umount.0 Request processed in 1891us (2131us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788652348.116600:0:11683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 240 00000100:00100000:0.0:1788652348.553635:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627791872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788652348.553719:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652348.554174:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627791872 00000100:00100000:3.0:1788652348.554182:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627791872 00000100:00100000:3.0:1788652348.554248:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788652348.554258:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627791872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788652348.554292:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652348.554350:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627791872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652348.554357:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788652348.554553:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627791872:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788652348.680039:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652349.577859:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788652349.577880:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a8b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627792000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788652349.577948:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652349.578078:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627792000 00000100:00100000:3.0:1788652349.578085:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627792000 00000100:00100000:3.0:1788652349.578140:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788652349.578150:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627792000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788652349.578183:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652349.578298:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627792000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652349.578306:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788652349.578438:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a8b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627792000:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788652349.707693:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652349.889184:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652349.889379:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652349.894019:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603696512 00000100:00100000:3.0:1788652349.894035:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603696512 00000100:00100000:0.0:1788652349.894046:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603696640 00000100:00100000:0.0:1788652349.894053:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603696640 00000100:00100000:0.0:1788652349.894111:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:0.0:1788652349.894134:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+11:2348:x1875537603696640:12345-192.168.203.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788652349.894144:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00010000:00010000:0.0:1788652349.894152:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652349.894173:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe7a0e5600/0x340ed74ef02a7600 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07da expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652349.894190:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652349.894263:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:2348:x1875537603696640:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 132us (4884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652349.894269:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:0.0:1788652349.894284:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603696768 00000100:00100000:0.0:1788652349.894287:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603696768 00000100:00100000:0.0:1788652349.894305:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 22 00000100:00100000:0.0:1788652349.894311:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+10:2347:x1875537603696768:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788652349.894320:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652349.894330:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe52925600/0x340ed74ef02a77c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f085f expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652349.894340:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652349.894358:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+9:2347:x1875537603696768:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 47us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652349.894364:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 22 00000100:00100000:3.0:1788652349.894420:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:3.0:1788652349.894430:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+8:2349:x1875537603696512:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652349.894448:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652349.894458:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe49e56000/0x340ed74ef02a75f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07b0 expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652349.894468:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652349.894488:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+7:2349:x1875537603696512:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 61us (5314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652349.894494:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:3.0:1788652349.911823:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652349.911913:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603697024 00000100:00100000:0.0:1788652349.911923:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603697024 00000100:00100000:0.0:1788652349.911996:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 241 00000100:00100000:0.0:1788652349.912005:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3eb94160-5684-49f0-9e45-fbf338e18f8d+6:2345:x1875537603697024:12345-192.168.203.50@tcp:39:umount.0 00000020:00000080:0.0:1788652349.912045:0:5835:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a760e 00000020:00010000:0.0:1788652349.912053:0:5835:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cbe7f382000: total 0 00000100:00080000:0.0:1788652349.912070:0:5835:0:(import.c:65:import_set_state_nolock()) ffff8cbe7f385000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788652349.912103:0:5835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1788652349.912320:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3eb94160-5684-49f0-9e45-fbf338e18f8d+5:2345:x1875537603697024:12345-192.168.203.50@tcp:39:umount.0 Request processed in 316us (554us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788652349.912328:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 241 00000020:00010000:2.0:1788652349.912581:0:5824:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cbe7f382000: total 0 00010000:00010000:2.0:1788652349.912618:0:5824:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cbe7f382000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788652349.912647:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe7fde3500) 00010000:00010000:2.0:1788652349.912658:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788652349.912667:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4a00/0x340ed74ef02a853b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c10 expref: 4 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652349.912690:0:5824:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cbe7f382000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788652349.912701:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652349.912703:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652349.912705:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652349.938820:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652349.938868:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603697280 00000100:00100000:0.0:1788652349.938879:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603697280 00000100:00100000:0.0:1788652349.938951:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 300 00000100:00100000:0.0:1788652349.938971:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe4b0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+7:2345:x1875537603697280:12345-192.168.203.50@tcp:251:umount.0 00000020:00000080:0.0:1788652349.939017:0:5829:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a7504 00000020:00010000:0.0:1788652349.939026:0:5829:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cbe81ec9800: total 0 00000100:00080000:0.0:1788652349.939031:0:5829:0:(import.c:65:import_set_state_nolock()) ffff8cbe81ecc800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788652349.939107:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe4b0c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7caf30d4-39a4-43d7-8f50-ddf5519bc0fc+3:2345:x1875537603697280:12345-192.168.203.50@tcp:251:umount.0 Request processed in 146us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652349.939114:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 300 00000020:00010000:1.0:1788652349.939264:0:5823:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cbe81ec9800: total 0 00010000:00010000:1.0:1788652349.939272:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652349.939321:0:5823:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cbe81ec9800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788652349.939354:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe7a0e4600/0x340ed74ef02a75ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f07a2 expref: 2 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652349.939369:0:5823:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cbe81ec9800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788652349.939378:0:5823:0:(genops.c:885:class_export_put()) final put ffff8cbe81ec9800/7caf30d4-39a4-43d7-8f50-ddf5519bc0fc 00010000:00010000:1.0:1788652349.939396:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652349.939398:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652349.939400:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788652349.939580:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe81ec9800/7caf30d4-39a4-43d7-8f50-ddf5519bc0fc for MGS 00000020:00000080:0.0:1788652349.939621:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe81ecc800 for MGS 00010000:00010000:0.0:1788652350.730330:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788652351.168315:0:5857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3eb94160-5684-49f0-9e45-fbf338e18f8d 00000001:00080000:3.0:1788652351.168332:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1788652351.168336:0:5857:0:(genops.c:885:class_export_put()) final put ffff8cbe7f382000/3eb94160-5684-49f0-9e45-fbf338e18f8d 00000001:00100000:3.0:1788652351.168608:0:5857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c 00000001:00080000:3.0:1788652351.168615:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1788652351.168629:0:5857:0:(genops.c:885:class_export_put()) final put ffff8cbe747a9800/20ec7f44-aadf-40d6-8a9c-d109a8b21d8c 00000020:00000080:0.0:1788652351.170319:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe7f382000/3eb94160-5684-49f0-9e45-fbf338e18f8d for lustre-MDT0000 00000020:00000080:0.0:1788652351.170393:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe7f385000 for lustre-MDT0000 00000020:00000080:2.0:1788652351.171218:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe747a9800/20ec7f44-aadf-40d6-8a9c-d109a8b21d8c for lustre-MDT0000 00000020:00000080:2.0:1788652351.171270:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe747a9000 for lustre-MDT0000 00000001:00100000:1.0:1788652351.176612:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c 00000020:00000080:1.0:1788652351.176619:0:6704:0:(genops.c:885:class_export_put()) final put ffff8cbe48683000/20ec7f44-aadf-40d6-8a9c-d109a8b21d8c 00000020:00000080:3.0:1788652351.176680:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe48683000/20ec7f44-aadf-40d6-8a9c-d109a8b21d8c for lustre-OST0000 00000020:00000080:3.0:1788652351.176728:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe48687000 for lustre-OST0000 00000020:01000004:1.0:1788652351.438597:0:12895:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788652351.463038:0:12895:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788652351.463091:0:12895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57000/0x340ed74ef02a7589 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7590 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652351.463107:0:12895:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57000/0x340ed74ef02a7589 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a7590 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652351.463116:0:12895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57000/0x340ed74ef02a7589 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x340ed74ef02a7590 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652351.463123:0:12895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57000/0x340ed74ef02a7589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x340ed74ef02a7590 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652351.463148:0:12895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788652351.463153:0:12895:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788652351.463191:0:12895:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788652351.463195:0:12895:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788652351.463213:0:12895:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788652351.463240:0:12895:0:(import.c:65:import_set_state_nolock()) ffff8cbe819e9000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788652351.463301:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652351.463308:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57000/0x340ed74ef02a7589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x340ed74ef02a7590 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652351.463315:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e57000 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:0.0:1788652351.463319:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57000/0x340ed74ef02a7589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x340ed74ef02a7590 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652351.463339:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57000/0x340ed74ef02a7589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x340ed74ef02a7590 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788652351.463347:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57000/0x340ed74ef02a7589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x340ed74ef02a7590 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652351.463352:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788652351.463355:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788652351.463357:0:5823:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788652351.463382:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57000/0x340ed74ef02a7589 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x340ed74ef02a7590 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652351.463387:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788652351.463417:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57000/0x340ed74ef02a7589 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x340ed74ef02a7590 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652351.463424:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57000/0x340ed74ef02a7589 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x340ed74ef02a7590 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652351.463435:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652351.463437:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652351.463438:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652351.463480:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788652351.463498:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627792256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788652351.463564:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652351.463814:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875537627792128:0@lo:39:umount.0 00000100:00100000:2.0:1788652351.463847:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652351.463928:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627792256 00000100:00100000:0.0:1788652351.463935:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627792256 00000100:00100000:0.0:1788652351.463991:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788652351.464000:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f811a652-691e-4a40-b660-977a4758dd08+19:3305:x1875537627792256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788652351.464013:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652351.464028:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe8215f000/0x340ed74ef02a7590 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x340ed74ef02a7589 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652351.464051:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652351.464091:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f811a652-691e-4a40-b660-977a4758dd08+18:3305:x1875537627792256:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652351.464098:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788652351.464133:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627792256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788652351.464197:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627792128 00000100:00100000:3.0:1788652351.464210:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627792128 00000100:00100000:3.0:1788652351.464254:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788652351.464262:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875537627792128:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788652351.464285:0:5836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a7313 00000100:00080000:3.0:1788652351.464293:0:5836:0:(import.c:65:import_set_state_nolock()) ffff8cbe819ee800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788652351.464343:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3302:x1875537627792128:12345-0@lo:39:umount.0 Request processed in 82us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652351.464356:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1788652351.464362:0:5836:0:(genops.c:885:class_export_put()) final put ffff8cbe819eb000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1788652351.464433:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cbe819e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788652351.464458:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875537627792128:0@lo:39:umount.0 00000020:00000080:1.0:1788652351.464527:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe819eb000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788652351.464577:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe819ee800 for lustre-MDT0000 00010000:00010000:0.0:1788652351.464643:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788652351.464739:0:12895:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788652351.464742:0:12895:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788652351.464746:0:12895:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788652351.465631:0:12895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a7597 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a759e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652351.466192:0:12895:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a7597 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a759e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652351.466213:0:12895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a7597 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x340ed74ef02a759e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652351.466221:0:12895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a7597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x340ed74ef02a759e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652351.466272:0:12895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652351.466280:0:12895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a200/0x340ed74ef02a74be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a74c5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652351.466287:0:12895:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a200/0x340ed74ef02a74be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a74c5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652351.466293:0:12895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a200/0x340ed74ef02a74be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x340ed74ef02a74c5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652351.466299:0:12895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a200/0x340ed74ef02a74be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x340ed74ef02a74c5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652351.466423:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788652351.466430:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a7597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x340ed74ef02a759e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652351.466438:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215f200 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:0.0:1788652351.466450:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a7597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x340ed74ef02a759e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652351.466459:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a7597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x340ed74ef02a759e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788652351.466466:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a7597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x340ed74ef02a759e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652351.466472:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788652351.466475:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788652351.466506:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a7597 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x340ed74ef02a759e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652351.466512:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788652351.466546:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a7597 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x340ed74ef02a759e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652351.466564:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a7597 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x340ed74ef02a759e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652351.466578:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652351.466582:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a200/0x340ed74ef02a74be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x340ed74ef02a74c5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652351.466587:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151a200 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:0.0:1788652351.466590:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a200/0x340ed74ef02a74be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x340ed74ef02a74c5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652351.466597:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a200/0x340ed74ef02a74be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x340ed74ef02a74c5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788652351.466603:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a200/0x340ed74ef02a74be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x340ed74ef02a74c5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652351.466608:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788652351.466610:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1788652351.466623:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a200/0x340ed74ef02a74be lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x340ed74ef02a74c5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652351.466627:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788652351.466633:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a200/0x340ed74ef02a74be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x340ed74ef02a74c5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652351.466639:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652351.466641:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652351.466642:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652351.466767:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627792512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652351.467006:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652351.467055:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788652351.467062:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627792384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652351.467084:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652351.467476:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627792512 00000100:00100000:0.0:1788652351.467484:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627792512 00000100:00100000:0.0:1788652351.467534:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627792384 00000100:00100000:0.0:1788652351.467537:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627792384 00000100:00100000:0.0:1788652351.467555:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788652351.467563:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe494af450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f811a652-691e-4a40-b660-977a4758dd08+19:3304:x1875537627792512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788652351.467575:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652351.467588:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe52924800/0x340ed74ef02a74c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x340ed74ef02a74be expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652351.467604:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652351.467642:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe494af450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f811a652-691e-4a40-b660-977a4758dd08+18:3304:x1875537627792512:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652351.467660:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788652351.467699:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788652351.467706:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f811a652-691e-4a40-b660-977a4758dd08+17:3304:x1875537627792384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788652351.467712:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652351.467721:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe49e56600/0x340ed74ef02a759e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x340ed74ef02a7597 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652351.467730:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652351.467761:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f811a652-691e-4a40-b660-977a4758dd08+16:3304:x1875537627792384:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652351.467768:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788652351.467817:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627792384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788652351.467826:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f811a652-691e-4a40-b660-977a4758dd08:3304:1875537627792512:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788652351.468229:0:12895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788652351.468236:0:12895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe4151a200/0x340ed74ef02a74be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x340ed74ef02a74c5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652351.468251:0:12895:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788652351.468260:0:12895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a77b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a77b9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652351.468266:0:12895:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a77b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a77b9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652351.468272:0:12895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a77b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x340ed74ef02a77b9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652351.468279:0:12895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a77b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x340ed74ef02a77b9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652351.468328:0:12895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652351.468335:0:12895:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b800/0x340ed74ef02a7272 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7279 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652351.468341:0:12895:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b800/0x340ed74ef02a7272 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a7279 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652351.468347:0:12895:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b800/0x340ed74ef02a7272 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x340ed74ef02a7279 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652351.468353:0:12895:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b800/0x340ed74ef02a7272 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x340ed74ef02a7279 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652351.468412:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788652351.468418:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a77b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x340ed74ef02a77b9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652351.468425:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e57800 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:1.0:1788652351.468428:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a77b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x340ed74ef02a77b9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652351.468435:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a77b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x340ed74ef02a77b9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788652351.468451:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a77b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x340ed74ef02a77b9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652351.468457:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788652351.468460:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788652351.468461:0:5823:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788652351.468483:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a77b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x340ed74ef02a77b9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652351.468489:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788652351.468516:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a77b2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x340ed74ef02a77b9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652351.468523:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57800/0x340ed74ef02a77b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x340ed74ef02a77b9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652351.468540:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652351.468543:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b800/0x340ed74ef02a7272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x340ed74ef02a7279 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652351.468549:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe4151b800 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:1.0:1788652351.468552:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b800/0x340ed74ef02a7272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x340ed74ef02a7279 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652351.468559:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b800/0x340ed74ef02a7272 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x340ed74ef02a7279 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788652351.468565:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b800/0x340ed74ef02a7272 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x340ed74ef02a7279 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652351.468570:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788652351.468572:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:1.0:1788652351.468587:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b800/0x340ed74ef02a7272 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x340ed74ef02a7279 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652351.468593:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788652351.468599:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b800/0x340ed74ef02a7272 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x340ed74ef02a7279 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652351.468606:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652351.468607:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652351.468609:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652351.468622:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe51336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627792768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788652351.468792:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652351.468831:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788652351.468845:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe819e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627792640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788652351.468870:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652351.468906:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627792768 00000100:00100000:1.0:1788652351.468911:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627792768 00000100:00100000:1.0:1788652351.468939:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627792640 00000100:00100000:1.0:1788652351.468942:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627792640 00000100:00100000:1.0:1788652351.468956:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788652351.468963:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51334380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f811a652-691e-4a40-b660-977a4758dd08+17:3306:x1875537627792768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788652351.468972:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652351.468982:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe52925800/0x340ed74ef02a7279 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x340ed74ef02a7272 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652351.468995:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652351.469023:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51334380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f811a652-691e-4a40-b660-977a4758dd08+16:3306:x1875537627792768:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652351.469030:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788652351.469042:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788652351.469048:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a284700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f811a652-691e-4a40-b660-977a4758dd08+15:3306:x1875537627792640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788652351.469055:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652351.469064:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe49e57c00/0x340ed74ef02a77b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x340ed74ef02a77b2 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652351.469071:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652351.469092:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a284700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f811a652-691e-4a40-b660-977a4758dd08+14:3306:x1875537627792640:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652351.469098:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788652351.469138:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe819e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627792640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788652351.469146:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe51336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f811a652-691e-4a40-b660-977a4758dd08:3306:1875537627792768:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788652351.469739:0:12895:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788652351.469747:0:12895:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe4151b800/0x340ed74ef02a7272 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x340ed74ef02a7279 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652351.469872:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652351.469939:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788652351.469981:0:12895:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:3.0:1788652351.469987:0:12895:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788652351.469989:0:12895:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788652351.470016:0:12895:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788652351.470021:0:12895:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788652351.470026:0:12895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788652351.470033:0:12895:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788652351.470038:0:12895:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8cbe5f857800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788652351.470043:0:12895:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8cbe7f61d000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788652351.470048:0:12895:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8cbe513419c0) has exports, disconnecting them 00000020:00080000:3.0:1788652351.470052:0:12895:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cbe5f857800), last request at 1788652348 00000020:00000080:3.0:1788652351.470059:0:12895:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a7486 00000100:00080000:3.0:1788652351.470077:0:12895:0:(import.c:65:import_set_state_nolock()) ffff8cbe5f853800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788652351.470129:0:12895:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbe5f857800): rc 0 00000020:00000080:3.0:1788652351.470132:0:12895:0:(genops.c:885:class_export_put()) final put ffff8cbe5f857800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788652351.470179:0:12895:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cbe7f61d000), last request at 1788652348 00000020:00000080:3.0:1788652351.470183:0:12895:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a73bb 00000100:00080000:3.0:1788652351.470189:0:12895:0:(import.c:65:import_set_state_nolock()) ffff8cbe7f618800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788652351.470198:0:12895:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbe7f61d000): rc 0 00000020:00000080:3.0:1788652351.470209:0:12895:0:(genops.c:885:class_export_put()) final put ffff8cbe7f61d000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:1.0:1788652351.470270:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652351.470274:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788652351.470296:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe5f857800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788652351.470363:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe5f853800 for lustre-MDT0000 00000004:00000080:3.0:1788652351.470417:0:12895:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa24681d9bae0 00000100:00080000:3.0:1788652351.470438:0:12895:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788652351.470449:0:12895:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1788652351.470475:0:12895:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788652351.470535:0:12895:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788652351.470553:0:12895:0:(import.c:65:import_set_state_nolock()) ffff8cbe7f384000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788652351.470567:0:12895:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788652351.470569:0:12895:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1788652351.470577:0:12895:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788652351.470632:0:12895:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788652351.470639:0:12895:0:(import.c:65:import_set_state_nolock()) ffff8cbe818db800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788652351.470676:0:12895:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8cbe513419c0) has no exports 00000100:00100000:3.0:1788652351.470893:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd41faa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875537627792896:0@lo:9:umount.0 00000100:00100000:3.0:1788652351.470944:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652351.470970:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd41faa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875537627793024:0@lo:9:umount.0 00000100:00100000:3.0:1788652351.470989:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652351.471021:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627792896 00000100:00100000:3.0:1788652351.471027:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627792896 00000100:00100000:3.0:1788652351.471068:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627793024 00000100:00100000:3.0:1788652351.471071:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627793024 00000100:00100000:3.0:1788652351.471091:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788652351.471099:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875537627792896:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788652351.471119:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a7408 00000100:00080000:3.0:1788652351.471126:0:6679:0:(import.c:65:import_set_state_nolock()) ffff8cbe7f66f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788652351.471153:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1788652351.471459:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3302:x1875537627792896:12345-0@lo:9:umount.0 Request processed in 361us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652351.471465:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788652351.471477:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788652351.471482:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875537627793024:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788652351.471491:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a74ef 00000100:00080000:3.0:1788652351.471501:0:6679:0:(import.c:65:import_set_state_nolock()) ffff8cbe512cc800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788652351.471515:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788652351.471579:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3302:x1875537627793024:12345-0@lo:9:umount.0 Request processed in 97us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652351.471585:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1788652351.471616:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cbe7f384000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788652351.471621:0:3302:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788652351.471622:0:3302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788652351.471626:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd41faa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875537627792896:0@lo:9:umount.0 00000100:00080000:3.0:1788652351.471635:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cbe818db800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788652351.471639:0:3302:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788652351.471640:0:3302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788652351.471642:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd41faa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875537627793024:0@lo:9:umount.0 00000100:00080000:0.0:1788652351.471899:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788652351.471903:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788652351.472236:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652351.472245:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788652351.472561:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe7f61d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788652351.472618:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe7f618800 for lustre-MDT0000 00000020:00080000:3.0:1788652351.476457:0:12895:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8cbe513419c0) has no exports 00000020:00000080:3.0:1788652351.518654:0:12895:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a72cd 00000020:00000080:3.0:1788652351.518670:0:12895:0:(genops.c:885:class_export_put()) final put ffff8cbe81a25000/lustre-QMT0000_UUID 00000020:01000000:3.0:1788652351.518727:0:12895:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788652351.518983:0:12895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788652351.518996:0:12895:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788652351.519001:0:12895:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8cbe7596b380) has no exports 00000020:00000080:2.0:1788652351.519340:0:12895:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a72c6 00000020:00000080:2.0:1788652351.519347:0:12895:0:(genops.c:885:class_export_put()) final put ffff8cbe75973800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788652351.519415:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe81a25000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788652351.519889:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe75973800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788652351.520077:0:12895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788652351.520086:0:12895:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788652351.520090:0:12895:0:(genops.c:885:class_export_put()) final put ffff8cbe7a8c7800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788652351.520093:0:12895:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe7a8c7800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788652351.520102:0:12895:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1788652351.520228:0:12895:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbe7a716f00 - data ffff8cbe572c2870/ffff8cbe7a49f800 00000020:01000000:2.0:1788652351.520350:0:12895:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbe81505420 - data ffff8cbe6e771e58/ffff8cbe744d0c00 00000001:00000004:2.0:1788652351.540407:0:12895:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788652351.613233:0:12895:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788652351.613241:0:12895:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788652351.613266:0:12895:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788652351.613269:0:12895:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788652351.613458:0:6799:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788652351.613463:0:6799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1788652351.613473:0:6799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788652351.614544:0:12895:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788652351.614549:0:12895:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788652351.614571:0:12895:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788652351.614574:0:12895:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788652351.615439:0:8047:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788652351.615445:0:8047:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1788652351.615456:0:8047:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788652351.685868:0:12895:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a7295 00000020:00000080:2.0:1788652351.685881:0:12895:0:(genops.c:885:class_export_put()) final put ffff8cbe7a8b9000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788652351.686850:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe7a8b9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788652351.687354:0:12895:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a72aa 00000020:00000080:2.0:1788652351.687364:0:12895:0:(genops.c:885:class_export_put()) final put ffff8cbe7a8c4800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788652351.687416:0:12895:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788652351.687425:0:12895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788652351.687435:0:12895:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788652351.687439:0:12895:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8cbe51340000) has no exports 00000004:01000000:2.0:1788652351.687606:0:12895:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788652351.687615:0:12895:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a74e8 00000020:00000080:2.0:1788652351.687620:0:12895:0:(genops.c:885:class_export_put()) final put ffff8cbe747aa000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788652351.688086:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe7a8c4800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788652351.688508:0:12895:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788652351.688515:0:12895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788652351.688524:0:12895:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788652351.688528:0:12895:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8cbe4b1719c0) has no exports 00000020:00000080:2.0:1788652351.688536:0:12895:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a74e1 00000020:00000080:2.0:1788652351.688543:0:12895:0:(genops.c:885:class_export_put()) final put ffff8cbe513ad800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788652351.688567:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe747aa000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:2.0:1788652351.689208:0:12895:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788652351.689213:0:12895:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788652351.689217:0:12895:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1788652351.689223:0:12895:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788652351.689225:0:12895:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788652351.689275:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe513ad800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788652351.689357:0:12895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788652351.689366:0:12895:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788652351.689375:0:12895:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a7401 00000020:00000080:2.0:1788652351.689381:0:12895:0:(genops.c:885:class_export_put()) final put ffff8cbe5f850000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788652351.689404:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe818db800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788652351.689410:0:38:0:(genops.c:885:class_export_put()) final put ffff8cbe513ac000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788652351.689412:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe513ac000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788652351.689416:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788652351.689614:0:12895:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788652351.689620:0:12895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788652351.689625:0:12895:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788652351.689627:0:12895:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8cbe759699c0) has no exports 00000020:00000080:2.0:1788652351.689632:0:12895:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a73fa 00000020:00000080:2.0:1788652351.689637:0:12895:0:(genops.c:885:class_export_put()) final put ffff8cbe7f387800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788652351.689652:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe5f850000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:2.0:1788652351.690255:0:12895:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788652351.690259:0:12895:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788652351.690262:0:12895:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1788652351.690267:0:12895:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788652351.690268:0:12895:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788652351.690422:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe7f387800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788652351.690561:0:12895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788652351.690569:0:12895:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788652351.690600:0:12895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788652351.690603:0:12895:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788652351.690607:0:12895:0:(genops.c:885:class_export_put()) final put ffff8cbe7a8b8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788652351.690610:0:12895:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe7a8b8000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788652351.690628:0:12895:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788652351.690838:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe7f384000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788652351.690845:0:38:0:(genops.c:885:class_export_put()) final put ffff8cbe7f386800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788652351.690847:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe7f386800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788652351.690851:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788652351.691080:0:12895:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a72b1 00000020:00000080:2.0:1788652351.691088:0:12895:0:(genops.c:885:class_export_put()) final put ffff8cbe7a8c5000/lustre-MDD0000_UUID 00000020:01000000:2.0:1788652351.691128:0:12895:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788652351.691132:0:12895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788652351.691137:0:12895:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788652351.691140:0:12895:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8cbe51344d40) has no exports 00000020:00000080:2.0:1788652351.691159:0:12895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788652351.691162:0:12895:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788652351.691165:0:12895:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a72b8 00000020:00000080:2.0:1788652351.691168:0:12895:0:(genops.c:885:class_export_put()) final put ffff8cbe7a8c0800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788652351.691208:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe7a8c5000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788652351.691212:0:38:0:(genops.c:885:class_export_put()) final put ffff8cbe7a8bb000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788652351.691214:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe7a8bb000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788652351.691221:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:2.0:1788652351.691506:0:12895:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbe50c46000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788652351.691511:0:12895:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe50c46000 3 00000020:01000004:2.0:1788652351.691514:0:12895:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cbe50c46000 from lustre-MDT0000 00000020:00000080:2.0:1788652351.691533:0:12895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788652351.691537:0:12895:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788652351.691540:0:12895:0:(genops.c:885:class_export_put()) final put ffff8cbe7a8ba000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788652351.691542:0:12895:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe7a8ba000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788652351.691552:0:12895:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788652351.691577:0:12895:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788652351.691581:0:12895:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788652351.691583:0:12895:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788652351.691586:0:12895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788652351.691590:0:12895:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788652351.691596:0:12895:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8cbe49567800 f811a652-691e-4a40-b660-977a4758dd08 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788652351.691601:0:12895:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8cbe51343380) has exports, disconnecting them 00000020:00080000:2.0:1788652351.691605:0:12895:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8cbe49567800), last request at 1788652137 00000020:00000080:2.0:1788652351.691618:0:12895:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a7256 00000020:00010000:2.0:1788652351.691622:0:12895:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8cbe49567800: total 1 00000100:00080000:2.0:1788652351.691625:0:12895:0:(import.c:65:import_set_state_nolock()) ffff8cbe49562800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788652351.691696:0:12895:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbe49567800): rc 0 00000020:00080000:2.0:1788652351.691700:0:12895:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8cbe51343380) has no exports 00000100:00100000:2.0:1788652351.691884:0:5830:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8cbe4955aa00:5830] 2 exiting: rc = 0 00000100:00100000:2.0:1788652351.692093:0:5828:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8cbe4955ba00:5828] 0 exiting: rc = 1 00000020:00000080:0.0:1788652351.692270:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe7a8c0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1788652351.692297:0:5829:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8cbe49519200:5829] 1 exiting: rc = 0 00000100:00100000:2.0:1788652351.692387:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.692396:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.692403:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.692409:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.692416:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.692421:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.692428:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.692434:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:1.0:1788652351.692530:0:5823:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8cbe49567800: total 0 00010000:00010000:1.0:1788652351.692564:0:5823:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cbe49567800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788652351.692590:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe49e56200/0x340ed74ef02a736e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x340ed74ef02a7367 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652351.692609:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe49e57600/0x340ed74ef02a7558 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x340ed74ef02a7551 expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652351.692620:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe7a0e4000/0x340ed74ef02a7574 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x340ed74ef02a756d expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652351.692629:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe7a0e5800/0x340ed74ef02a7566 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x340ed74ef02a755f expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652351.692639:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe49e56c00/0x340ed74ef02a7582 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x340ed74ef02a757b expref: 5 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652351.692649:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe52925e00/0x340ed74ef02a779d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x340ed74ef02a7796 expref: 4 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652351.692659:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe49e57200/0x340ed74ef02a75ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x340ed74ef02a75a5 expref: 3 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652351.692670:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe49e56a00/0x340ed74ef02a77ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x340ed74ef02a77a4 expref: 2 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652351.692694:0:5823:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cbe49567800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1788652351.692706:0:5823:0:(genops.c:885:class_export_put()) final put ffff8cbe49567800/f811a652-691e-4a40-b660-977a4758dd08 00010000:00010000:1.0:1788652351.692725:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652351.692728:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652351.692730:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652351.692842:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.692852:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.692857:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.692862:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.692867:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.692872:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.692877:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.692882:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.692889:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.692894:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.692900:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.692906:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.692912:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.692917:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.692922:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.692928:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.692933:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788652351.693085:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe49567800/f811a652-691e-4a40-b660-977a4758dd08 for MGS 00000020:00000080:0.0:1788652351.693123:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe49562800 for MGS 00000100:00100000:2.0:1788652351.693158:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693163:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693169:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693175:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693180:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693185:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693190:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693196:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693223:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693228:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693232:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693236:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693242:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693247:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693253:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693258:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693263:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693269:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693273:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693278:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693283:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693288:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693293:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693298:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693303:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693308:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693313:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693318:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693324:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693330:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693336:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693342:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693347:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693352:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693357:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693363:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693368:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693373:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.693378:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1788652351.694308:0:12895:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788652351.694313:0:12895:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1788652351.695910:0:12895:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbe436acd80 - data ffff8cbe7fa031b0/ffff8cbe74abe000 00000020:01000000:2.0:1788652351.696243:0:12895:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbe6ce79f00 - data ffff8cbe516f8870/ffff8cbe4b114000 00000020:00000080:2.0:1788652351.696909:0:12895:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a723a 00000020:00000080:2.0:1788652351.696919:0:12895:0:(genops.c:885:class_export_put()) final put ffff8cbe49223000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788652351.697271:0:12895:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbe50c46000 from MGS, refs=2 00000020:01000004:2.0:1788652351.697276:0:12895:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe50c46000 2 00000020:00000080:1.0:1788652351.697276:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe49223000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:2.0:1788652351.697281:0:12895:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cbe50c46000 from MGS 00000020:00000080:2.0:1788652351.697311:0:12895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788652351.697319:0:12895:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788652351.697322:0:12895:0:(genops.c:885:class_export_put()) final put ffff8cbe49226000/MGS 00000020:00000080:2.0:1788652351.697325:0:12895:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe49226000/MGS for MGS 00000020:01000000:2.0:1788652351.697331:0:12895:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788652351.697387:0:12895:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788652351.697392:0:12895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788652351.697399:0:12895:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788652351.697407:0:12895:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8cbe819ef800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788652351.697413:0:12895:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8cbe75968000) has exports, disconnecting them 00000020:00080000:2.0:1788652351.697418:0:12895:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8cbe819ef800), last request at 1788652138 00000020:00000080:2.0:1788652351.697422:0:12895:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a7305 00000020:00080000:2.0:1788652351.697433:0:12895:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbe819ef800): rc 0 00000020:00000080:2.0:1788652351.697437:0:12895:0:(genops.c:885:class_export_put()) final put ffff8cbe819ef800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788652351.698885:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe819ef800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788652351.703932:0:12895:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788652351.704090:0:12895:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788652351.704094:0:12895:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788652351.704101:0:12895:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788652351.711252:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe819e9000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788652351.711525:0:12895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788652351.711536:0:12895:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788652351.711541:0:12895:0:(genops.c:885:class_export_put()) final put ffff8cbe75975000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788652351.711545:0:12895:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe75975000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788652351.711551:0:12895:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788652351.711614:0:12895:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe50c46000 1 00000020:00000080:1.0:1788652351.711619:0:12895:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a722c 00000020:00000080:1.0:1788652351.711627:0:12895:0:(genops.c:885:class_export_put()) final put ffff8cbe49227800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788652351.711637:0:12895:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788652351.711646:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe49227800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788652351.711664:0:12895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788652351.711670:0:12895:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788652351.711673:0:12895:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8cbe4717cd40) has no exports 00000020:00000080:1.0:1788652351.732253:0:12895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788652351.732270:0:12895:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788652351.732285:0:12895:0:(genops.c:885:class_export_put()) final put ffff8cbe49dc1800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788652351.732289:0:12895:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe49dc1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788652351.732297:0:12895:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788652351.733690:0:12895:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cbe50c41000 00000020:01000000:1.0:1788652351.733722:0:12895:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788652351.733736:0:12895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788652351.733743:0:12895:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788652351.733748:0:12895:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8cbe4717b380) has no exports 00000100:00100000:1.0:1788652351.733870:0:5837:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8cbe52af2e00:5837] 2 exiting: rc = 0 00000100:00100000:1.0:1788652351.736631:0:5835:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8cbe52af3200:5835] 0 exiting: rc = 1 00000100:00100000:1.0:1788652351.736722:0:11683:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8cbe4944b000:11683] 4 exiting: rc = 0 00000100:00100000:0.0:1788652351.737360:0:6701:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8cbe4a5f1400:6701] 3 exiting: rc = 0 00000100:00100000:3.0:1788652351.740322:0:5836:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8cbe52af3400:5836] 1 exiting: rc = 0 00000100:00100000:1.0:1788652351.740632:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740642:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740648:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740654:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740661:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740667:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740673:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740679:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740685:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740691:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740697:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740703:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740709:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740715:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740720:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740725:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740731:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740738:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740744:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740749:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740767:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740816:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740822:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740828:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740833:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740839:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740844:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740850:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740859:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740878:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740884:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740890:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740896:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740913:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740920:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740925:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.740930:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741099:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741108:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741114:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741120:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741124:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741129:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741134:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741140:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741144:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741149:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741154:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741159:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741164:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741169:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741174:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741179:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741184:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741189:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741193:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741207:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741213:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741218:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741223:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741228:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741232:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741237:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.741242:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.747929:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8cbe48f2f400:5839] 1 exiting: rc = 0 00000100:00100000:0.0:1788652351.748053:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8cbe52af3000:5838] 0 exiting: rc = 1 00000100:00100000:1.0:1788652351.748286:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748296:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748302:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748309:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748315:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748321:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748326:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748333:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748338:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748343:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748348:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748354:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748361:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748367:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748371:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748376:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748382:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748387:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748392:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748397:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748403:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748408:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748413:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748418:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748423:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748428:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748433:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748438:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748444:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748449:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748455:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748460:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748465:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748470:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748476:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748495:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748500:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748620:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748629:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748634:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748639:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748645:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748650:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748655:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748660:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748666:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748674:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748681:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748688:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748693:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748699:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748705:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748713:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748720:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748728:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748735:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748742:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748749:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748756:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.748763:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.749107:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.749117:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.749122:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.749127:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.749751:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8cbe4b181a00:5840] 0 exiting: rc = 1 00000100:00100000:1.0:1788652351.750122:0:12399:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8cbe493bc400:12399] 2 exiting: rc = 0 00000100:00100000:2.0:1788652351.750235:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8cbe4b180400:5841] 1 exiting: rc = 0 00000100:00100000:0.0:1788652351.750756:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.750789:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.750800:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.750808:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.750822:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.750828:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.750834:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.750841:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.750846:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.750852:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.750858:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.750864:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.750888:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.750898:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.750904:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.750910:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.750917:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.750923:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.750929:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.751799:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.751812:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.751818:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.751825:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.751832:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.751856:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.751863:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.751871:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.751889:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.751898:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.751904:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.751910:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.751915:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.751921:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.751927:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.752288:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.752298:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.752320:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.752327:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.752679:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.752930:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.753295:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.753301:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.753307:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.753313:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.753319:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.753325:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.753464:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.753472:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.753500:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.753795:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.753803:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.753809:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.753815:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.753822:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.753827:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.753834:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.753840:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.753847:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.753853:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.753860:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.753891:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.753899:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.753918:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.753924:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.774987:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8cbe4b181800:5842] 0 exiting: rc = 1 00000100:00100000:2.0:1788652351.775241:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8cbe47b88600:5843] 1 exiting: rc = 0 00000100:00100000:1.0:1788652351.775452:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.775463:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.775470:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.775477:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.775499:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.775653:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.775663:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.775670:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.775676:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.775684:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.775692:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.775698:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.775705:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.775712:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.775719:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.775728:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.775734:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.775741:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.775748:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776100:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776111:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776119:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776126:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776132:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776139:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776146:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776154:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776161:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776169:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776175:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776182:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776189:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776196:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776211:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776220:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776227:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776235:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776241:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776249:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776268:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776370:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776376:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776382:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776387:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776393:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776397:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776402:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776407:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776413:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776418:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776423:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776428:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776433:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776448:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776454:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776459:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776464:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776468:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776473:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776478:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776483:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776487:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776491:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652351.776496:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.778368:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8cbe47b88a00:5844] 0 exiting: rc = 1 00000100:00100000:1.0:1788652351.779253:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8cbe4a5e5c00:5845] 1 exiting: rc = 0 00000100:00100000:2.0:1788652351.779457:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779473:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779480:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779486:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779490:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779495:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779504:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779519:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779524:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779529:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779550:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779555:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779560:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779564:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779569:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779574:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779580:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779585:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779590:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779600:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779605:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779610:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779616:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779621:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779625:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779630:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779634:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779639:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779645:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779651:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779655:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779660:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779665:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779671:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779676:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779681:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779687:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779693:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779698:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779703:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779708:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779713:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779717:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779722:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779728:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779741:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779746:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779751:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779756:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779760:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779792:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779799:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779919:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779923:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779927:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.779931:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.780301:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.780324:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.780331:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.780337:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.780344:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.780352:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.780358:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.780364:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.781481:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8cbe47b89a00:5847] 1 exiting: rc = 0 00000100:00100000:1.0:1788652351.781725:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8cbe47b88000:5846] 0 exiting: rc = 1 00000100:00100000:2.0:1788652351.781880:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.781886:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.781890:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.781895:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.781911:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.781917:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.781921:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.781927:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.781932:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.782427:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.782433:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.782652:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.782661:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.782667:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.782695:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.782701:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.782734:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.782739:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783194:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783214:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783220:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783225:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783229:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783234:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783239:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783243:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783247:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783251:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783256:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783262:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783267:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783272:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783277:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783281:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783346:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783354:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783359:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783364:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783369:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783374:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783378:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783382:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783387:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783392:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783397:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783402:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783407:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783413:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783418:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783423:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783428:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783509:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783581:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783590:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783598:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783605:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783611:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783617:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783623:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783629:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783635:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783640:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783646:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.783653:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652351.785889:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8cbe47b89400:5848] 0 exiting: rc = 1 00000100:00100000:2.0:1788652351.786662:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8cbe47b89c00:5850] 2 exiting: rc = 0 00000100:00100000:1.0:1788652351.787596:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8cbe47b88e00:5849] 1 exiting: rc = 0 00000100:00100000:2.0:1788652351.787727:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.787736:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.787745:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788309:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788321:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788329:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788338:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788345:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788353:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788373:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788381:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788386:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788392:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788399:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788404:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788411:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788416:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788422:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788427:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788432:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788438:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788676:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788681:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788685:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788690:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788695:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788700:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788705:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788711:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788715:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788721:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788727:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788732:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788748:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788763:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788864:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788874:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788880:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788886:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.788892:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.789049:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.789056:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.789062:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.789071:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.789078:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.789083:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.789088:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.789093:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.789098:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.789106:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.789112:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.789117:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.789122:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.789127:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.789134:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.789139:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.789153:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.789159:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.789164:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.789170:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.789177:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.789184:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.789189:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652351.789195:0:12895:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788652351.796568:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788652351.804547:0:12895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788652351.804561:0:12895:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788652351.804566:0:12895:0:(genops.c:885:class_export_put()) final put ffff8cbe49da0800/MDS_uuid 00000020:00000080:3.0:1788652351.804571:0:12895:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe49da0800/MDS_uuid for MDS 00000020:01000000:3.0:1788652351.804585:0:12895:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788652351.804701:0:12895:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788652352.840010:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652353.160905:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627793152:0@lo:400:kworker.0 00000400:00000100:2.0:1788652353.160963:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875537627793152 offset 0 length 224: 4 00000100:00100000:2.0:1788652353.161019:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788652353.161025:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627793280:0@lo:400:kworker.0 00000400:00000100:2.0:1788652353.161045:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875537627793280 offset 0 length 224: 4 00000100:00100000:2.0:1788652353.161073:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627793408:0@lo:400:kworker.0 00000400:00000100:2.0:1788652353.161089:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875537627793408 offset 0 length 224: 4 00000001:00100000:3.0:1788652353.205924:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 20ec7f44-aadf-40d6-8a9c-d109a8b21d8c 00000020:00000080:3.0:1788652353.205933:0:7631:0:(genops.c:885:class_export_put()) final put ffff8cbe7a485800/20ec7f44-aadf-40d6-8a9c-d109a8b21d8c 00000001:00100000:3.0:1788652353.205960:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788652353.205970:0:7631:0:(genops.c:885:class_export_put()) final put ffff8cbe512cd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788652353.206097:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe7a485800/20ec7f44-aadf-40d6-8a9c-d109a8b21d8c for lustre-OST0001 00000020:00000080:2.0:1788652353.206147:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe512cd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788652353.206171:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe7a481800 for lustre-OST0001 00000020:00000080:2.0:1788652353.206177:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe512cc800 for lustre-OST0001 00010000:00010000:3.0:1788652353.863925:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788652354.305445:0:13048:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788652354.324979:0:13048:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788652354.325037:0:13048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52924000/0x340ed74ef02a756d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7574 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652354.325051:0:13048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52924000/0x340ed74ef02a756d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a7574 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652354.325076:0:13048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52924000/0x340ed74ef02a756d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x340ed74ef02a7574 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652354.325083:0:13048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8cbe52924000/0x340ed74ef02a756d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x340ed74ef02a7574 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652354.325109:0:13048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788652354.325115:0:13048:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788652354.325137:0:13048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788652354.325148:0:13048:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbe7f90ce00 x1875537627793280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652369 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652354.325164:0:13048:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788652354.325169:0:13048:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788652354.325204:0:13048:0:(import.c:65:import_set_state_nolock()) ffff8cbe7f687000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788652354.325225:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652354.325233:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe52924000/0x340ed74ef02a756d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x340ed74ef02a7574 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652354.325240:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe52924000 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:3.0:1788652354.325244:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe52924000/0x340ed74ef02a756d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x340ed74ef02a7574 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652354.325252:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe52924000/0x340ed74ef02a756d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x340ed74ef02a7574 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788652354.325260:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe52924000/0x340ed74ef02a756d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x340ed74ef02a7574 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652354.325266:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788652354.325268:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788652354.325270:0:5823:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788652354.325297:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe52924000/0x340ed74ef02a756d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x340ed74ef02a7574 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652354.325304:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788652354.325333:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe52924000/0x340ed74ef02a756d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x340ed74ef02a7574 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652354.325349:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe52924000/0x340ed74ef02a756d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x340ed74ef02a7574 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652354.325357:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875537627793536:0@lo:39:umount.0 00010000:00010000:3.0:1788652354.325359:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652354.325361:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652354.325369:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652354.325380:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788652354.325390:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627793664:0@lo:103:ldlm_bl.0 00000400:00000100:0.0:1788652354.325406:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875537627793536 offset 0 length 224: 4 00000100:00100000:3.0:1788652354.325424:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652354.325469:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627793664 00000100:00100000:3.0:1788652354.325476:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627793664 00000100:00100000:3.0:1788652354.325522:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788652354.325530:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3305:x1875537627793664:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788652354.325535:0:5822:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788652354 with bad export cookie 3751172273682936406 00000100:00100000:2.0:1788652354.325576:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627793280:0@lo:400:kworker.0 00000100:00100000:3.0:1788652354.336015:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3305:x1875537627793664:12345-0@lo:103:ldlm_bl.0 Request processed in 10476us (10581us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788652354.336029:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788652354.336112:0:3305:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.150@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788652354.336118:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8cbe49563000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788652354.336122:0:3305:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.150@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788652354.344694:0:3305:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.150@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788652354.344697:0:3305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788652354.344705:0:3305:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbe7f90f480 x1875537627793152/t0(0) o400->MGC192.168.203.150@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788652369 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652354.345062:0:3305:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbe7f2f8a80 x1875537627793664/t0(0) o103->MGC192.168.203.150@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788652370 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788652354.345072:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788652354.345075:0:3305:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788652354.345076:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788652354.345080:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8cbe49563000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788652354.345085:0:3305:0:(import.c:545:import_select_connection()) MGC192.168.203.150@tcp: connect to NID 0@lo last attempt 154 00000100:00080000:0.0:1788652354.345094:0:3305:0:(import.c:665:import_select_connection()) MGC192.168.203.150@tcp: import ffff8cbe49563000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1788652354.345199:0:3305:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe7f2fb100 x1875537627793792/t0(0) o250->MGC192.168.203.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788652354.345241:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f811a652-691e-4a40-b660-977a4758dd08:3305:1875537627793664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788652354.345307:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f811a652-691e-4a40-b660-977a4758dd08:3302:1875537627793792:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1788652354.345363:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875537627793792 offset 0 length 520: 4 00000100:00100000:1.0:1788652354.345415:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f811a652-691e-4a40-b660-977a4758dd08:3303:1875537627793152:0@lo:400:kworker.0 00010000:00010000:3.0:1788652354.888080:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652355.913338:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788652356.282409:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788652356.282415:0:6704:0:(genops.c:885:class_export_put()) final put ffff8cbe7f669000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788652356.282471:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe7f669000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788652356.282520:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe7f66f000 for lustre-OST0000 00010000:00010000:3.0:1788652356.935934:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652357.959895:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788652358.280815:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) f811a652-691e-4a40-b660-977a4758dd08->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788652358.280825:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) f811a652-691e-4a40-b660-977a4758dd08->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788652358.280927:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875537627793920:0@lo:400:kworker.0 00000400:00000100:1.0:1788652358.280990:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875537627793920 offset 0 length 224: 4 00010000:00010000:3.0:1788652358.983951:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788652359.304614:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) f811a652-691e-4a40-b660-977a4758dd08->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788652359.304623:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) f811a652-691e-4a40-b660-977a4758dd08->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788652359.304724:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788652359.304745:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875537627794048:0@lo:400:kworker.0 00000400:00000100:1.0:1788652359.305399:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875537627794048 offset 0 length 224: 4 00010000:00010000:3.0:1788652360.008301:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652361.032154:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652362.056123:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652363.079943:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652364.103968:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788652364.424855:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) f811a652-691e-4a40-b660-977a4758dd08->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788652364.424864:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) f811a652-691e-4a40-b660-977a4758dd08->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788652364.424960:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627794176:0@lo:400:kworker.0 00000400:00000100:0.0:1788652364.425015:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875537627794176 offset 0 length 224: 4 00000100:00100000:0.0:1788652364.935923:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652354/real 1788652354] req@ffff8cbe7f2fb100 x1875537627793792/t0(0) o250->MGC192.168.203.150@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788652364 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652364.935979:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbe7f2fb100 x1875537627793792/t0(0) o250->MGC192.168.203.150@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788652364 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652364.935991:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652354/real 1788652354] req@ffff8cbe7a284e00 x1875537627793536/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788652364 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652364.936003:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbe7a284e00 x1875537627793536/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788652364 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788652364.936020:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cbe49563000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788652364.936044:0:3302:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788652364.936048:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f811a652-691e-4a40-b660-977a4758dd08:3302:1875537627793792:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:0.0:1788652364.936055:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cbe7f687000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788652364.936071:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875537627793536:0@lo:39:umount.0 00000100:00080000:3.0:1788652364.936197:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) f811a652-691e-4a40-b660-977a4758dd08->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788652364.936204:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788652364.936207:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cbe49563000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788652364.936214:0:8:0:(import.c:545:import_select_connection()) MGC192.168.203.150@tcp: connect to NID 0@lo last attempt 371 00000100:00080000:3.0:1788652364.936221:0:8:0:(import.c:630:import_select_connection()) MGC192.168.203.150@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788652364.936229:0:8:0:(import.c:665:import_select_connection()) MGC192.168.203.150@tcp: import ffff8cbe49563000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1788652364.936260:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe7f2f8700 x1875537627794304/t0(0) o250->MGC192.168.203.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788652364.936269:0:13048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788652364.936274:0:13048:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788652364.936281:0:13048:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1788652364.936332:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f811a652-691e-4a40-b660-977a4758dd08:3302:1875537627794304:0@lo:250:kworker.0 00000400:00000100:0.0:1788652364.936398:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875537627794304 offset 0 length 520: 4 00010000:00010000:1.0:1788652364.937197:0:13048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52924600/0x340ed74ef02a757b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7582 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652364.937211:0:13048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52924600/0x340ed74ef02a757b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a7582 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652364.937219:0:13048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52924600/0x340ed74ef02a757b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x340ed74ef02a7582 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652364.937226:0:13048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8cbe52924600/0x340ed74ef02a757b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x340ed74ef02a7582 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652364.937249:0:13048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788652364.937257:0:13048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57400/0x340ed74ef02a77a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a77ab expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652364.937263:0:13048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57400/0x340ed74ef02a77a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a77ab expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652364.937268:0:13048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57400/0x340ed74ef02a77a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x340ed74ef02a77ab expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652364.937274:0:13048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57400/0x340ed74ef02a77a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x340ed74ef02a77ab expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652364.939199:0:13048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788652364.939213:0:13048:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788652364.939262:0:13048:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788652364.939267:0:13048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788652364.939274:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788652364.939281:0:13048:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788652364.939286:0:13048:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8cbe47178000) has no exports 00000020:00080000:1.0:1788652364.939312:0:13048:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8cbe47178000) has no exports 00010000:00010000:3.0:1788652364.943996:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652364.943996:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788652364.944012:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57400/0x340ed74ef02a77a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x340ed74ef02a77ab expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652364.944024:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe49e57400 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:3.0:1788652364.944028:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57400/0x340ed74ef02a77a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x340ed74ef02a77ab expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652364.944107:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57400/0x340ed74ef02a77a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x340ed74ef02a77ab expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788652364.944187:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57400/0x340ed74ef02a77a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x340ed74ef02a77ab expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652364.944196:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788652364.944200:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788652364.944218:0:5824:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788652364.944239:0:5824:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cbe49563000 00010000:00010000:3.0:1788652364.944243:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57400/0x340ed74ef02a77a4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x340ed74ef02a77ab expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652364.944249:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe49e57400/0x340ed74ef02a77a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x340ed74ef02a77ab expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652364.944263:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652364.944265:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652364.944266:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652364.944355:0:13054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652364.944358:0:13054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652364.944360:0:13054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652364.946153:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe52924600/0x340ed74ef02a757b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x340ed74ef02a7582 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652364.946171:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe52924600 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:3.0:1788652364.946175:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe52924600/0x340ed74ef02a757b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x340ed74ef02a7582 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652364.946185:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe52924600/0x340ed74ef02a757b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x340ed74ef02a7582 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788652364.946192:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe52924600/0x340ed74ef02a757b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x340ed74ef02a7582 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652364.946197:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788652364.946199:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788652364.946202:0:5823:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788652364.946217:0:5823:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cbe49563000 00010000:00010000:3.0:1788652364.946222:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe52924600/0x340ed74ef02a757b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x340ed74ef02a7582 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652364.946249:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe52924600/0x340ed74ef02a757b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x340ed74ef02a7582 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652364.946264:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652364.946266:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652364.946269:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788652364.947680:0:13048:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbe7fd3a0c0 - data ffff8cbe7ff79000/ffff8cbe7f7e2000 00000020:01000000:1.0:1788652364.947821:0:13048:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbe45173000 - data ffff8cbe570d5798/ffff8cbe7f399000 00100000:10000000:1.0:1788652364.959475:0:13048:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788652364.994844:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a738a 00000020:00000080:3.0:1788652364.994856:0:13048:0:(genops.c:885:class_export_put()) final put ffff8cbe747ab000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788652364.994871:0:13048:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbe818bc800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788652364.994875:0:13048:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe818bc800 2 00000020:01000004:3.0:1788652364.994877:0:13048:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cbe818bc800 from lustre-OST0000 00000020:00000080:3.0:1788652364.994903:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788652364.994914:0:13048:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788652364.994917:0:13048:0:(genops.c:885:class_export_put()) final put ffff8cbe747ae000/lustre-OST0000_UUID 00000020:00000080:3.0:1788652364.994919:0:13048:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe747ae000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788652364.994927:0:13048:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788652364.994969:0:13048:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788652364.994973:0:13048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788652364.994978:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788652364.994983:0:13048:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788652364.994990:0:13048:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8cbe7f66c000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788652364.994995:0:13048:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8cbe4b170000) has exports, disconnecting them 00000020:00080000:3.0:1788652364.995000:0:13048:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8cbe7f66c000), last request at 1788652157 00000020:00000080:3.0:1788652364.995004:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a73b4 00000020:00080000:3.0:1788652364.995013:0:13048:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbe7f66c000): rc 0 00000020:00000080:3.0:1788652364.995018:0:13048:0:(genops.c:885:class_export_put()) final put ffff8cbe7f66c000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788652364.995266:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe747ab000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788652364.995275:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe7f66c000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788652364.996896:0:13048:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788652364.996905:0:13048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788652364.996909:0:13048:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788652364.996917:0:13048:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788652364.997124:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788652364.997134:0:13048:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788652364.997140:0:13048:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe818bc800 1 00000020:00000080:2.0:1788652364.997146:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a7344 00000020:00000080:2.0:1788652364.997154:0:13048:0:(genops.c:885:class_export_put()) final put ffff8cbe47147800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788652364.997377:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe7f687000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788652364.997384:0:8:0:(genops.c:885:class_export_put()) final put ffff8cbe747a8800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788652364.997387:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe747a8800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788652364.997392:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788652364.997501:0:13048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788652364.997506:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788652364.997512:0:13048:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788652364.997516:0:13048:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8cbe4b173380) has no exports 00000020:00000080:0.0:1788652364.997580:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe47147800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788652365.019892:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788652365.019909:0:13048:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788652365.019927:0:13048:0:(genops.c:885:class_export_put()) final put ffff8cbe818b8000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788652365.019933:0:13048:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe818b8000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788652365.019941:0:13048:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788652365.020072:0:13048:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cbe818be800 00000020:02000400:0.0:1788652365.020123:0:13048:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788652365.128856:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652366.154075:0:13054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652367.176878:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788652367.456531:0:13204:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788652367.470885:0:13204:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788652367.470967:0:13204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a7551 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7558 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652367.470982:0:13204:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a7551 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a7558 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652367.470990:0:13204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a7551 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x340ed74ef02a7558 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652367.470998:0:13204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a7551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x340ed74ef02a7558 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652367.471019:0:13204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788652367.471024:0:13204:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788652367.471045:0:13204:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788652367.471056:0:13204:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbe7f90c000 x1875537627793408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652369 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652367.471071:0:13204:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbe7a284000 x1875537627793920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652374 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652367.471084:0:13204:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbe7f2f8a80 x1875537627794048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652375 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652367.471116:0:13204:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbe7f2fb800 x1875537627794176/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652380 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652367.471124:0:13204:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1788652367.471155:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875537627794048:0@lo:400:kworker.0 00000100:00100000:1.0:1788652367.471163:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875537627793920:0@lo:400:kworker.0 00000100:00080000:1.0:1788652367.471194:0:13204:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788652367.471217:0:13204:0:(import.c:65:import_set_state_nolock()) ffff8cbe81eca800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788652367.471251:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627794176:0@lo:400:kworker.0 00000100:00100000:1.0:1788652367.471259:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875537627793408:0@lo:400:kworker.0 00000100:00100000:1.0:1788652367.471290:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875537627794432:0@lo:39:umount.0 00000400:00000100:1.0:1788652367.471335:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875537627794432 offset 0 length 224: 4 00010000:00010000:2.0:1788652367.471519:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652367.471526:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a7551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x340ed74ef02a7558 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652367.471536:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215ee00 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:2.0:1788652367.471539:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a7551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x340ed74ef02a7558 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652367.471548:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a7551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x340ed74ef02a7558 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652367.471555:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a7551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x340ed74ef02a7558 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652367.471560:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788652367.471562:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788652367.471564:0:5824:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788652367.471575:0:5824:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cbe49563000 00010000:00010000:2.0:1788652367.471578:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a7551 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x340ed74ef02a7558 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652367.471584:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a7551 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x340ed74ef02a7558 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652367.471601:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652367.471603:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652367.471605:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652368.200018:0:13054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652369.224490:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788652370.055907:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) f811a652-691e-4a40-b660-977a4758dd08->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788652370.055917:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) f811a652-691e-4a40-b660-977a4758dd08->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788652370.248046:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652371.274876:0:13054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652372.297601:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652373.320134:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652374.349063:0:13054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788652375.175916:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) f811a652-691e-4a40-b660-977a4758dd08->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788652375.175926:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) f811a652-691e-4a40-b660-977a4758dd08->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788652375.367924:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652376.393563:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652377.416002:0:13054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652377.671982:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652367/real 1788652367] req@ffff8cbe7a284000 x1875537627794432/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788652377 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652377.672018:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbe7a284000 x1875537627794432/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788652377 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788652377.672047:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cbe81eca800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788652377.672123:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875537627794432:0@lo:39:umount.0 00000100:00080000:0.0:1788652377.679334:0:13204:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788652377.679342:0:13204:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788652377.679350:0:13204:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788652377.689403:0:13204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52924c00/0x340ed74ef02a755f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a7566 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652377.689422:0:13204:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52924c00/0x340ed74ef02a755f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a7566 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652377.689449:0:13204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe52924c00/0x340ed74ef02a755f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x340ed74ef02a7566 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652377.689456:0:13204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8cbe52924c00/0x340ed74ef02a755f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x340ed74ef02a7566 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652377.689552:0:13204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788652377.689561:0:13204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe40031000/0x340ed74ef02a7796 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a779d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652377.689568:0:13204:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe40031000/0x340ed74ef02a7796 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a779d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652377.689574:0:13204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe40031000/0x340ed74ef02a7796 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x340ed74ef02a779d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652377.689687:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652377.689695:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe52924c00/0x340ed74ef02a755f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x340ed74ef02a7566 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652377.689703:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe52924c00 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:3.0:1788652377.689707:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe52924c00/0x340ed74ef02a755f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x340ed74ef02a7566 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652377.689716:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe52924c00/0x340ed74ef02a755f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x340ed74ef02a7566 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788652377.689723:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe52924c00/0x340ed74ef02a755f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x340ed74ef02a7566 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652377.689730:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788652377.689733:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1788652377.689745:0:5823:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cbe49563000 00010000:00010000:3.0:1788652377.689748:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe52924c00/0x340ed74ef02a755f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x340ed74ef02a7566 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652377.689755:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe52924c00/0x340ed74ef02a755f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x340ed74ef02a7566 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652377.689806:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652377.689808:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652377.689810:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652377.689970:0:13204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.150@tcp lock: ffff8cbe40031000/0x340ed74ef02a7796 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x340ed74ef02a779d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652377.689991:0:13204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788652377.689996:0:13204:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1788652377.690001:0:13204:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788652377.690035:0:13204:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788652377.690039:0:13204:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788652377.690046:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788652377.690052:0:13204:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788652377.690057:0:13204:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8cbe513c0000) has no exports 00000020:00080000:1.0:1788652377.690082:0:13204:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8cbe513c0000) has no exports 00010000:00010000:2.0:1788652377.691662:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652377.691674:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe40031000/0x340ed74ef02a7796 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x340ed74ef02a779d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652377.691685:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe40031000 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:2.0:1788652377.691690:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe40031000/0x340ed74ef02a7796 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x340ed74ef02a779d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652377.691700:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe40031000/0x340ed74ef02a7796 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x340ed74ef02a779d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652377.691709:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe40031000/0x340ed74ef02a7796 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x340ed74ef02a779d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652377.691715:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788652377.691719:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788652377.691722:0:5824:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788652377.691736:0:5824:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cbe49563000 00010000:00010000:2.0:1788652377.691740:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe40031000/0x340ed74ef02a7796 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x340ed74ef02a779d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652377.691762:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe40031000/0x340ed74ef02a7796 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x340ed74ef02a779d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652377.691813:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652377.691816:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652377.691818:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788652377.700107:0:13204:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbe7fd3af60 - data ffff8cbe514371b0/ffff8cbe7a0cdc00 00000020:01000000:1.0:1788652377.701705:0:13204:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cbe7fd3a600 - data ffff8cbe7febe5e8/ffff8cbe7f7e0000 00100000:10000000:1.0:1788652377.711535:0:13204:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788652377.761990:0:13204:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a7455 00000020:00000080:0.0:1788652377.762001:0:13204:0:(genops.c:885:class_export_put()) final put ffff8cbe790e7000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788652377.762084:0:13204:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbe7fdf4800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788652377.762088:0:13204:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe7fdf4800 2 00000020:01000004:0.0:1788652377.762091:0:13204:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cbe7fdf4800 from lustre-OST0001 00000020:00000080:0.0:1788652377.762117:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788652377.762128:0:13204:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788652377.762131:0:13204:0:(genops.c:885:class_export_put()) final put ffff8cbe7f61f800/lustre-OST0001_UUID 00000020:00000080:0.0:1788652377.762134:0:13204:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe7f61f800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788652377.762141:0:13204:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788652377.763432:0:13204:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import f811a652-691e-4a40-b660-977a4758dd08->MGS 00010000:00010000:0.0:1788652377.763453:0:13204:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe4151aa00/0x340ed74ef02a7367 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x340ed74ef02a736e expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788652377.763468:0:13204:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe4151aa00/0x340ed74ef02a7367 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x340ed74ef02a736e expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652377.763475:0:13204:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788652377.763477:0:13204:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788652377.763480:0:13204:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788652377.763495:0:13204:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cbe49563000 00010000:00010000:0.0:1788652377.763499:0:13204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe4151aa00/0x340ed74ef02a7367 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x340ed74ef02a736e expref: -99 pid: 6675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652377.763533:0:13204:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4800/0x340ed74ef02a75a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x340ed74ef02a75ac expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788652377.763541:0:13204:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4800/0x340ed74ef02a75a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x340ed74ef02a75ac expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652377.763547:0:13204:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788652377.763549:0:13204:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788652377.763551:0:13204:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788652377.763567:0:13204:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cbe49563000 00010000:00010000:0.0:1788652377.763569:0:13204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4800/0x340ed74ef02a75a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x340ed74ef02a75ac expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788652377.763596:0:13204:0:(import.c:65:import_set_state_nolock()) ffff8cbe49563000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788652377.763600:0:13204:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788652377.763602:0:13204:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788652377.763603:0:13204:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788652377.763609:0:13204:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788652377.763620:0:13204:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cbe7f2f8700 x1875537627794304/t0(0) o250->MGC192.168.203.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788652379 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788652377.763815:0:13204:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788652377.763818:0:13204:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000020:00000080:1.0:1788652377.765083:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe790e7000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1788652377.766715:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f811a652-691e-4a40-b660-977a4758dd08:3302:1875537627794304:0@lo:250:kworker.0 10000000:01000000:0.0:1788652377.766834:0:13204:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788652377.766846:0:13204:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a7248 00000020:00000080:0.0:1788652377.766856:0:13204:0:(genops.c:885:class_export_put()) final put ffff8cbe49da4000/f811a652-691e-4a40-b660-977a4758dd08 00000020:01000000:0.0:1788652377.766873:0:13204:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.150@tcp (flags='') 00000020:00000080:0.0:1788652377.766882:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788652377.766891:0:13204:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.150@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788652377.766895:0:13204:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8cbe4b174d40) has no exports 10000000:01000000:2.0:1788652377.766954:0:5832:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788652377.767067:0:13204:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.150@tcp: client import never connected 00000100:00080000:0.0:1788652377.767084:0:13204:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788652377.767087:0:13204:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788652377.767090:0:13204:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788652377.767092:0:13204:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788652377.767129:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788652377.767136:0:13204:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.150@tcp (uuid f811a652-691e-4a40-b660-977a4758dd08) 00000020:01000000:0.0:1788652377.767142:0:13204:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788652377.767145:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788652377.767149:0:13204:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788652377.767155:0:13204:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8cbe81ecc000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788652377.767160:0:13204:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8cbe513c19c0) has exports, disconnecting them 00000020:00080000:0.0:1788652377.767165:0:13204:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8cbe81ecc000), last request at 1788652176 00000020:00000080:0.0:1788652377.767169:0:13204:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a747f 00000020:00080000:0.0:1788652377.767180:0:13204:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cbe81ecc000): rc 0 00000020:00000080:0.0:1788652377.767183:0:13204:0:(genops.c:885:class_export_put()) final put ffff8cbe81ecc000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788652377.768104:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe49da4000/f811a652-691e-4a40-b660-977a4758dd08 for MGC192.168.203.150@tcp 00000020:00000080:1.0:1788652377.768118:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe49563000 for MGC192.168.203.150@tcp 00000020:00000080:1.0:1788652377.768124:0:36:0:(genops.c:885:class_export_put()) final put ffff8cbe49562000/f811a652-691e-4a40-b660-977a4758dd08 00000020:00000080:1.0:1788652377.768126:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe49562000/f811a652-691e-4a40-b660-977a4758dd08 for MGC192.168.203.150@tcp 00000020:01000000:1.0:1788652377.768131:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.150@tcp (f811a652-691e-4a40-b660-977a4758dd08) 00000020:00000080:1.0:1788652377.769522:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe81ecc000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788652377.769863:0:13204:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788652377.769868:0:13204:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788652377.769873:0:13204:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788652377.769877:0:13204:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788652377.769979:0:13054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:2.0:1788652377.770106:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8cbe81eca800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1788652377.770183:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788652377.770374:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788652377.770524:0:8497:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8cbe49ce1a00:8497] 2 exiting: rc = 0 00000100:00100000:2.0:1788652377.770993:0:5819:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8cbe4b326200:5819] 1 exiting: rc = 0 00000100:00100000:1.0:1788652377.781047:0:5818:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8cbe43708800:5818] 0 exiting: rc = 1 00000100:00100000:2.0:1788652377.781211:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.781475:0:5821:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8cbe49519000:5821] 1 exiting: rc = 0 00000100:00100000:2.0:1788652377.781545:0:5822:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8cbe43708000:5822] 2 exiting: rc = 0 00000100:00100000:1.0:1788652377.781959:0:5820:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8cbe4b327a00:5820] 0 exiting: rc = 1 00000100:00100000:2.0:1788652377.782591:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782600:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782607:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782612:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782617:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782623:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782629:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782635:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782641:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782647:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782653:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782659:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782664:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782671:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782693:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782698:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782705:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782711:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782716:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782723:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782729:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782734:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782740:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782746:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782752:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782757:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782763:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782769:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782798:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782803:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782808:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782814:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782820:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782825:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782831:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782836:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782841:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782847:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782852:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782857:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782862:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782867:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782872:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782877:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782883:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782888:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782894:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782899:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782904:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782917:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782923:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782928:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782933:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782939:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782944:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782949:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782955:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782961:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782966:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782971:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782977:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782981:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782986:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.782992:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788652377.784087:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788652377.784097:0:13204:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788652377.784103:0:13204:0:(genops.c:885:class_export_put()) final put ffff8cbe818d9800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788652377.784108:0:13204:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe818d9800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788652377.784113:0:13204:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1788652377.784161:0:13204:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe7fdf4800 1 00000020:00000080:2.0:1788652377.784167:0:13204:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x340ed74ef02a7424 00000020:00000080:2.0:1788652377.784174:0:13204:0:(genops.c:885:class_export_put()) final put ffff8cbe7f61f000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788652377.784421:0:13204:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788652377.784427:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788652377.784432:0:13204:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788652377.784436:0:13204:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8cbe471799c0) has no exports 00000020:00000080:1.0:1788652377.789739:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe7f61f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788652377.819401:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788652377.819423:0:13204:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788652377.819430:0:13204:0:(genops.c:885:class_export_put()) final put ffff8cbe7fdf0000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788652377.819435:0:13204:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe7fdf0000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788652377.819444:0:13204:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788652377.820015:0:13204:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cbe7fdf7000 00000020:01000000:1.0:1788652377.820111:0:13204:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788652377.820116:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788652377.820121:0:13204:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788652377.820125:0:13204:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8cbe513c3380) has no exports 00000020:00000080:1.0:1788652377.820145:0:13204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788652377.820162:0:13204:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788652377.820166:0:13204:0:(genops.c:885:class_export_put()) final put ffff8cbe47142800/OSS_uuid 00000020:00000080:1.0:1788652377.820168:0:13204:0:(genops.c:844:class_export_destroy()) destroying export ffff8cbe47142800/OSS_uuid for OSS 00000020:01000000:1.0:1788652377.820173:0:13204:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788652377.822900:0:5831:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788652377.822948:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8cbe451c7000:6680] 2 exiting: rc = 0 00000100:00100000:3.0:1788652377.823056:0:6678:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8cbe7a2a6c00:6678] 0 exiting: rc = 1 00000100:00100000:0.0:1788652377.827951:0:8297:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8cbe7fdeec00:8297] 3 exiting: rc = 0 00000100:00100000:1.0:1788652377.831889:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8cbe7a2a6800:6679] 1 exiting: rc = 0 00000100:00100000:1.0:1788652377.832014:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832033:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832041:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832047:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832052:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832057:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832063:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832067:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832074:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832080:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832085:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832095:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832101:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832106:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832111:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832116:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832122:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832127:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832133:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832138:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832144:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832149:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832154:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832159:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832165:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832171:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832176:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832181:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832186:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832214:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832219:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832226:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832231:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832237:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832243:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832248:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832253:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832258:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832263:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832268:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832273:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832278:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832283:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832287:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832292:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832297:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832301:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832306:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832311:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832316:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832335:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832341:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832347:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832352:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832358:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832363:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832368:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832373:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832378:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832383:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832389:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832394:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832399:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.832405:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652377.837108:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8cbe7a719200:6682] 1 exiting: rc = 0 00000100:00100000:3.0:1788652377.837430:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8cbe451c7a00:6681] 0 exiting: rc = 1 00000100:00100000:1.0:1788652377.837517:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837531:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837536:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837542:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837547:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837552:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837558:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837564:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837569:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837574:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837592:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837598:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837604:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837609:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837614:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837619:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837624:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837629:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837634:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837640:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837645:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837649:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837655:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837676:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837683:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837688:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837693:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837699:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837705:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837709:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837715:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837720:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837726:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837732:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837737:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837759:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837765:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837796:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837803:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837808:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837814:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837819:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837824:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837829:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837834:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837840:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837845:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837850:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837856:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837862:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837868:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837873:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837882:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837888:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837894:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837899:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837904:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837910:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837915:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837920:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837925:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837931:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837936:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.837941:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652377.839137:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8cbe513c9000:6685] 2 exiting: rc = 0 00000100:00100000:1.0:1788652377.841413:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8cbe7a718a00:6684] 1 exiting: rc = 0 00000100:00100000:1.0:1788652377.842920:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8cbe7a719a00:6683] 0 exiting: rc = 1 00000100:00100000:1.0:1788652377.843037:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843046:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843051:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843057:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843092:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843098:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843106:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843112:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843117:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843123:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843128:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843133:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843138:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843144:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843151:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843157:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843162:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843197:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843205:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843211:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843216:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843222:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843228:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843234:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843240:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843246:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843252:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843257:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843263:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843268:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843274:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843279:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843285:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843290:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843296:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843301:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843307:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843312:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843319:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843334:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843339:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843360:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843367:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843373:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843380:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843385:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843392:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843397:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843403:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843410:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843415:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843422:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843428:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843434:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843439:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843445:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843452:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843458:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843464:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843470:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843476:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843482:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843488:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.843501:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.861387:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8cbe7c889800:6686] 0 exiting: rc = 1 00000100:00100000:3.0:1788652377.862155:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8cbe4a5e4000:6687] 1 exiting: rc = 0 00000100:00100000:1.0:1788652377.862377:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862385:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862390:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862395:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862400:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862406:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862410:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862414:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862419:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862435:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862440:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862445:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862450:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862455:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862460:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862465:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862469:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862473:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862478:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862483:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862488:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862493:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862498:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862502:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862507:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862512:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862517:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862521:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862525:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862530:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862535:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862540:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862545:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862550:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862555:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862560:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862565:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862570:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.862575:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.863885:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.863892:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.863897:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.863902:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.863907:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.863926:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.863931:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.863936:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.863941:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.863946:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.863951:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.863956:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.863961:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.863966:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.863972:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.863977:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.863986:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.863996:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.864004:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.864010:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.864015:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.864033:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.864040:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.864044:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.864050:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.867293:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8cbe7c889c00:6688] 0 exiting: rc = 1 00000100:00100000:1.0:1788652377.868006:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8cbe4b3bb800:6689] 1 exiting: rc = 0 00000100:00100000:1.0:1788652377.868083:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868092:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868099:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868121:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868128:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868134:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868142:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868148:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868153:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868159:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868164:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868170:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868175:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868205:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868212:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868235:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868243:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868249:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868255:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868261:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868267:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868274:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868281:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868289:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868296:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868302:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868307:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868329:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868335:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868341:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868350:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868355:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868361:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868366:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868371:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868377:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868382:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868388:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868393:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868412:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868419:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868425:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868430:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868436:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868441:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868446:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868451:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868457:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868470:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868475:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868481:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868500:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868505:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868510:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868516:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868522:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868528:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868534:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868540:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868546:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868551:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868559:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.868566:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652377.870987:0:13204:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788652377.887905:0:13204:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788652394.266583:0:13823:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788652401.946220:0:14286:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788652401.946225:0:14286:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788652401.946539:0:14286:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cbe48680800 00000020:01000004:2.0:1788652401.946556:0:14286:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788652401.946575:0:14286:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788652401.946601:0:14286:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8cbe513c19c0) 00000020:00000080:2.0:1788652401.946625:0:14286:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788652401.966505:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788652401.968460:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788652401.968902:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 347: rc = 0 00100000:10000000:2.0:1788652401.969007:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 347: rc = 0 00100000:10000000:2.0:1788652401.969410:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 347: rc = 0 00100000:10000000:2.0:1788652401.969504:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 347: rc = 0 00100000:10000000:2.0:1788652401.969689:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788652401.969755:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 347: rc = 0 00100000:10000000:2.0:1788652401.969977:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 347: rc = 0 00100000:10000000:2.0:1788652401.970211:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 349: rc = 0 00100000:10000000:2.0:1788652401.971382:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 249: rc = 0 00100000:10000000:2.0:1788652401.971480:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 249: rc = 0 00100000:10000000:2.0:1788652401.972017:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 513: rc = 0 00100000:10000000:2.0:1788652401.972357:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 513: rc = 0 00100000:10000000:2.0:1788652401.972592:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 513: rc = 0 00100000:10000000:2.0:1788652401.972918:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 513: rc = 0 00100000:10000000:2.0:1788652401.973167:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 513: rc = 0 00100000:10000000:2.0:1788652401.973406:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 513: rc = 0 00100000:10000000:2.0:1788652401.973689:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 513: rc = 0 00100000:10000000:2.0:1788652401.974083:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 513: rc = 0 00100000:10000000:2.0:1788652401.974321:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 513: rc = 0 00100000:10000000:2.0:1788652401.974559:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 513: rc = 0 00100000:10000000:2.0:1788652401.975086:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 513: rc = 0 00100000:10000000:2.0:1788652401.975337:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 513: rc = 0 00100000:10000000:2.0:1788652401.975726:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 526: rc = 0 00100000:10000000:2.0:1788652401.976250:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 526: rc = 0 00100000:10000000:2.0:1788652401.976484:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 526: rc = 0 00100000:10000000:2.0:1788652401.976722:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 526: rc = 0 00100000:10000000:2.0:1788652401.977081:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 526: rc = 0 00100000:10000000:2.0:1788652401.977340:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 526: rc = 0 00100000:10000000:2.0:1788652401.977562:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 526: rc = 0 00100000:10000000:2.0:1788652401.977932:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 526: rc = 0 00100000:10000000:2.0:1788652401.978172:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 526: rc = 0 00100000:10000000:2.0:1788652401.978442:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 526: rc = 0 00100000:10000000:2.0:1788652401.978682:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 526: rc = 0 00100000:10000000:2.0:1788652401.979131:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 526: rc = 0 00100000:10000000:2.0:1788652401.979374:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 526: rc = 0 00100000:10000000:2.0:1788652401.979613:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 526: rc = 0 00100000:10000000:2.0:1788652401.979969:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 526: rc = 0 00100000:10000000:2.0:1788652401.980206:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 526: rc = 0 00100000:10000000:2.0:1788652401.980447:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 526: rc = 0 00100000:10000000:2.0:1788652401.980682:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 526: rc = 0 00100000:10000000:2.0:1788652401.980995:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 526: rc = 0 00100000:10000000:2.0:1788652401.981215:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 526: rc = 0 00100000:10000000:2.0:1788652401.981527:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 526: rc = 0 00100000:10000000:2.0:1788652401.981757:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 526: rc = 0 00100000:10000000:2.0:1788652401.982038:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 526: rc = 0 00100000:10000000:2.0:1788652401.982260:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 526: rc = 0 00100000:10000000:2.0:1788652401.982492:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 526: rc = 0 00100000:10000000:2.0:1788652401.982741:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 526: rc = 0 00100000:10000000:2.0:1788652401.983081:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 526: rc = 0 00100000:10000000:2.0:1788652401.983329:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 526: rc = 0 00100000:10000000:2.0:1788652401.983569:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 526: rc = 0 00100000:10000000:2.0:1788652401.984093:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 526: rc = 0 00100000:10000000:2.0:1788652401.984347:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 526: rc = 0 00100000:10000000:2.0:1788652401.984587:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 526: rc = 0 00100000:10000000:2.0:1788652401.985094:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 515: rc = 0 00100000:10000000:2.0:1788652401.985579:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788652401.985740:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 492: rc = 0 00100000:10000000:2.0:1788652401.986011:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788652401.986075:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 492: rc = 0 00100000:10000000:2.0:1788652401.986247:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788652401.986316:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 492: rc = 0 00100000:10000000:2.0:1788652401.988300:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788652401.988415:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 250: rc = 0 00100000:10000000:2.0:1788652401.988657:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788652401.988734:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 250: rc = 0 00100000:10000000:2.0:1788652401.990349:0:14286:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788652401.990437:0:14286:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 250: rc = 0 00000020:00000080:2.0:1788652401.990708:0:14286:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788652401.990716:0:14286:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788652401.990728:0:14286:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x340ed74ef02a8549 00000020:01000004:2.0:1788652401.990736:0:14286:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788652401.990741:0:14286:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788652401.990746:0:14286:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cbe48680800 from MGS 00000020:01000004:2.0:1788652401.990750:0:14286:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788652401.990760:0:14286:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8cbe513c4d40) 00000020:00000080:2.0:1788652401.991518:0:14286:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788652401.991587:0:14286:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbe48680800 from MGS, refs=2 00080000:01000000:2.0:1788652401.991602:0:14286:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788652401.991610:0:14286:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x340ed74ef02a8557 00000100:00100000:2.0:1788652401.991722:0:14286:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788652401.992161:0:14286:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788652401.992168:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788652401.992559:0:14286:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788652401.992566:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788652401.993245:0:14286:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788652401.993388:0:14286:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788652401.993393:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788652401.994171:0:14286:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788652401.994180:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788652401.994465:0:14286:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788652401.994470:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788652401.995382:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652401.995386:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652401.995388:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652401.995730:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652401.995733:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652401.995734:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652401.996374:0:14286:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788652402.000930:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788652402.005554:0:14286:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788652402.005573:0:14286:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788652402.005576:0:14286:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788652402.010832:0:14295:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788652402.011048:0:14286:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788652402.011154:0:14286:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788652402.011613:0:14286:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788652402.011965:0:14286:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788652402.012132:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788652402.012138:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788652402.012681:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788652402.012688:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788652402.015178:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788652402.015188:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788652402.025149:0:14286:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788652402.025204:0:14286:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.150@tcp' 00000020:01000004:2.0:1788652402.025207:0:14286:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788652402.025239:0:14286:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.150@tcp (typ=mgc) 00000020:00000080:2.0:1788652402.025252:0:14286:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.150@tcp (ffff8cbe513c3380) 00000020:00000080:2.0:1788652402.025269:0:14286:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788652402.025341:0:14286:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbe48681000@MGC192.168.203.150@tcp: add connection 192.168.203.150@tcp at head 00010000:00010000:2.0:1788652402.025587:0:14286:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.150@tcp-0 is initialized 00000040:01000000:2.0:1788652402.025593:0:14286:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.150@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788652402.025813:0:14300:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788652402.027081:0:14301:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788652402.027161:0:14286:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.150@tcp (uuid 4a384a7b-92b2-4f9e-a496-63aebbb65331) 00000020:00000080:2.0:1788652402.027182:0:14286:0:(genops.c:1385:class_connect()) connect: client 4a384a7b-92b2-4f9e-a496-63aebbb65331, cookie 0x340ed74ef02a8565 00000100:00080000:2.0:1788652402.027194:0:14286:0:(import.c:545:import_select_connection()) MGC192.168.203.150@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788652402.027200:0:14286:0:(import.c:665:import_select_connection()) MGC192.168.203.150@tcp: import ffff8cbe48681000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1788652402.027232:0:14286:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe7f90c380 x1875537627794560/t0(0) o250->MGC192.168.203.150@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788652402.027266:0:14286:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 4a384a7b-92b2-4f9e-a496-63aebbb65331->MGS 00000020:01000004:2.0:1788652402.027284:0:14286:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788652402.027289:0:14286:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788652402.027302:0:14286:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8cbe513c0000) 00000020:00000080:2.0:1788652402.027312:0:14286:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788652402.030951:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4a384a7b-92b2-4f9e-a496-63aebbb65331:3302:1875537627794560:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788652402.031024:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652402.031110:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627794560 00000100:00100000:3.0:1788652402.031118:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627794560 00000100:00100000:3.0:1788652402.031148:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788652402.031155:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3302:x1875537627794560:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788652402.031179:0:14297:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4a384a7b-92b2-4f9e-a496-63aebbb65331@0@lo t0 exp 0000000000000000 cur 419 last 0 00000020:00000080:3.0:1788652402.031208:0:14297:0:(genops.c:1385:class_connect()) connect: client 4a384a7b-92b2-4f9e-a496-63aebbb65331, cookie 0x340ed74ef02a8573 00000100:00080000:3.0:1788652402.031339:0:14297:0:(import.c:65:import_set_state_nolock()) ffff8cbe43ebc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788652402.031387:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+5:3302:x1875537627794560:12345-0@lo:250:mount.lustre.0 Request processed in 230us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652402.031394:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788652402.031436:0:3302:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.150@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788652402.031444:0:3302:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.150@tcp: connect to target with instance 0 00000100:00080000:3.0:1788652402.031451:0:3302:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.150@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788652402.031456:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788652402.031459:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cbe48681000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788652402.031461:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788652402.031468:0:3302:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788652402.031473:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4a384a7b-92b2-4f9e-a496-63aebbb65331:3302:1875537627794560:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788652402.043315:0:14286:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788652402.043507:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788652402.043513:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788652402.054433:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788652402.054445:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788652402.056530:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788652402.056541:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788652402.061195:0:14286:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788652402.061639:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788652402.061647:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788652402.064698:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788652402.064711:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788652402.100530:0:14286:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788652402.100722:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788652402.100729:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788652402.102109:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788652402.102118:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788652402.107759:0:14286:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788652402.107985:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788652402.107991:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788652402.109421:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788652402.109441:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788652402.110523:0:14286:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788652402.111271:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788652402.111278:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788652402.118554:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788652402.118623:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788652402.119682:0:14286:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788652402.120044:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788652402.120049:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788652402.121211:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788652402.121221:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788652402.147595:0:14286:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788652402.148191:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788652402.148200:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788652402.150117:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788652402.150259:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788652402.155019:0:14286:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788652402.155031:0:14286:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788652402.156232:0:14286:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788652402.156263:0:14286:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788652402.156269:0:14286:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.150@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788652402.156399:0:14286:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.150@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788652402.156435:0:14286:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.150@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788652402.156439:0:14286:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788652402.156441:0:14286:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788652402.156442:0:14286:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788652402.156443:0:14286:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788652402.156444:0:14286:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788652402.156445:0:14286:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788652402.156446:0:14286:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788652402.156448:0:14286:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788652402.156449:0:14286:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788652402.156451:0:14286:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788652402.156453:0:14286:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788652402.156456:0:14286:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788652402.156457:0:14286:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788652402.156458:0:14286:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788652402.156459:0:14286:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788652402.156460:0:14286:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788652402.156462:0:14286:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788652402.156463:0:14286:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788652402.156464:0:14286:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788652402.156465:0:14286:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788652402.156466:0:14286:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788652402.156492:0:14286:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788652402.156511:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a287800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627794688:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788652402.156584:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652402.156702:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b76a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788652402.156758:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627794688 00000100:00100000:0.0:1788652402.156766:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627794688 00000100:00100000:0.0:1788652402.157020:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788652402.157033:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+5:14286:x1875537627794688:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788652402.157088:0:14299:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788652402.157091:0:14299:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788652402.157094:0:14299:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788652402.157494:0:14320:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788652402.157892:0:14299:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1788652402.159384:0:14321:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788652402.159391:0:14321:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788652402.159394:0:14321:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788652402.159428:0:14321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788652402.159732:0:14299:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788652402.159742:0:14299:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788652402.168790:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+5:14286:x1875537627794688:12345-0@lo:253:mount.lustre.0 Request processed in 11738us (12183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652402.168826:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788652402.170765:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a287800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627794688:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788652402.171246:0:14286:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788652402.171250:0:14286:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788652402.171251:0:14286:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788652402.171252:0:14286:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788652402.171253:0:14286:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788652402.171255:0:14286:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788652402.171255:0:14286:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788652402.171257:0:14286:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788652402.171258:0:14286:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788652402.171260:0:14286:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788652402.171260:0:14286:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788652402.171283:0:14286:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cbe48680800 from lustre-MDT0000 10000000:01000000:0.0:1788652402.171314:0:14286:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788652402.171317:0:14286:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788652402.171322:0:14286:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cbe513c3380 10000000:01000000:0.0:1788652402.171327:0:14286:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788652402.171335:0:14286:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cbe513c3380 from 1 10000000:01000000:0.0:1788652402.171337:0:14286:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788652402.171379:0:14286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10200/0x340ed74ef02a857a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652402.171402:0:14286:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10200/0x340ed74ef02a857a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652402.171484:0:14286:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10200/0x340ed74ef02a857a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652402.171509:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627794816:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788652402.171571:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652402.171767:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7f2cbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788652402.171989:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627794816 00000100:00100000:3.0:1788652402.171996:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627794816 00000100:00100000:3.0:1788652402.172198:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788652402.172208:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+5:14286:x1875537627794816:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652402.172222:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652402.172236:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7a0e4c00/0x340ed74ef02a8581 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a857a expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652402.172258:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7a0e4c00/0x340ed74ef02a8581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a857a expref: 6 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652402.172267:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7a0e4c00/0x340ed74ef02a8581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a857a expref: 6 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652402.172288:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e4c00, rc 0) 00000100:00100000:3.0:1788652402.172342:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+6:14286:x1875537627794816:12345-0@lo:101:mount.lustre.0 Request processed in 136us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652402.172348:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788652402.172431:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627794816:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788652402.172445:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10200/0x340ed74ef02a857a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8581 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652402.172454:0:14286:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10200/0x340ed74ef02a857a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a8581 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652402.172502:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627794944:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652402.172528:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652402.172802:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7f2cbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788652402.173007:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627794944 00000100:00100000:1.0:1788652402.173013:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627794944 00000100:00100000:1.0:1788652402.173039:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788652402.173056:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+6:14286:x1875537627794944:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652402.173427:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+6:14286:x1875537627794944:12345-0@lo:501:mount.lustre.0 Request processed in 380us (897us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788652402.173434:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788652402.173558:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627794944:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788652402.173590:0:14286:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788652402.173617:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10200/0x340ed74ef02a857a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8581 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652402.173625:0:14286:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10200/0x340ed74ef02a857a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8581 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652402.173646:0:14286:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cbe48680800 10000000:01000000:0.0:1788652402.173651:0:14286:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788652402.173655:0:14286:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cbe48680800 10000000:01000000:0.0:1788652402.173657:0:14286:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788652402.173809:0:14286:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cbe48680800 from 1 10000000:01000000:0.0:1788652402.173812:0:14286:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788652402.173842:0:14286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd11c00/0x340ed74ef02a8588 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652402.173849:0:14286:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd11c00/0x340ed74ef02a8588 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652402.173869:0:14286:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd11c00/0x340ed74ef02a8588 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652402.173885:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627795072:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788652402.173929:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652402.173952:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7f2cbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788652402.174215:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627795072 00000100:00100000:1.0:1788652402.174221:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627795072 00000100:00100000:1.0:1788652402.174247:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788652402.174254:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+6:14286:x1875537627795072:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788652402.174262:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652402.174275:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7a0c8800/0x340ed74ef02a858f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a8588 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652402.174294:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7a0c8800/0x340ed74ef02a858f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a8588 expref: 7 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652402.174303:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7a0c8800/0x340ed74ef02a858f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a8588 expref: 7 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652402.174312:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c8800, rc 0) 00000100:00100000:1.0:1788652402.174342:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+7:14286:x1875537627795072:12345-0@lo:101:mount.lustre.0 Request processed in 88us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652402.174348:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788652402.174513:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627795072:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788652402.174526:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd11c00/0x340ed74ef02a8588 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a858f expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652402.174536:0:14286:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd11c00/0x340ed74ef02a8588 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a858f expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652402.174550:0:14286:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788652402.174725:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd11c00/0x340ed74ef02a8588 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a858f expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652402.174743:0:14286:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd11c00/0x340ed74ef02a8588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a858f expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652402.174750:0:14286:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788652402.174754:0:14286:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788652402.174759:0:14286:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cbe48680800 10000000:01000000:0.0:1788652402.174761:0:14286:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788652402.174764:0:14286:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788652402.174766:0:14286:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788652402.174811:0:14286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd11000/0x340ed74ef02a8596 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652402.174818:0:14286:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd11000/0x340ed74ef02a8596 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652402.174826:0:14286:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd11000/0x340ed74ef02a8596 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652402.174841:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627795200:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788652402.174884:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652402.174920:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7f2cbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788652402.175040:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627795200 00000100:00100000:2.0:1788652402.175054:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627795200 00000100:00100000:2.0:1788652402.175094:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788652402.175103:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+7:14286:x1875537627795200:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788652402.175110:0:14299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652402.175286:0:14299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe8215e400/0x340ed74ef02a859d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a8596 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652402.175306:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe8215e400/0x340ed74ef02a859d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a8596 expref: 8 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652402.175315:0:14299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe8215e400/0x340ed74ef02a859d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a8596 expref: 8 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652402.175321:0:14299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215e400, rc 0) 00000100:00100000:2.0:1788652402.175368:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+8:14286:x1875537627795200:12345-0@lo:101:mount.lustre.0 Request processed in 266us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652402.175374:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788652402.175452:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627795200:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788652402.175465:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd11000/0x340ed74ef02a8596 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a859d expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652402.175472:0:14286:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd11000/0x340ed74ef02a8596 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a859d expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652402.175528:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627795328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652402.175552:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652402.175579:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7f2cbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788652402.175741:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627795328 00000100:00100000:2.0:1788652402.175746:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627795328 00000100:00100000:2.0:1788652402.175801:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788652402.175808:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+8:14286:x1875537627795328:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652402.176348:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+9:14286:x1875537627795328:12345-0@lo:501:mount.lustre.0 Request processed in 539us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652402.176356:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788652402.176571:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627795328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652402.176619:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627795456:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788652402.176661:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652402.176692:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7f2cbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788652402.176708:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627795456 00000100:00100000:0.0:1788652402.176715:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627795456 00000100:00100000:0.0:1788652402.176749:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788652402.176756:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+9:14286:x1875537627795456:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788652402.177994:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+9:14286:x1875537627795456:12345-0@lo:503:mount.lustre.0 Request processed in 1232us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652402.178004:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788652402.178208:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8fbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627795456:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788652402.178722:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a284000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a384a7b-92b2-4f9e-a496-63aebbb65331:14322:1875537627795584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788652402.178850:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652402.179190:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b76a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788652402.179235:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627795584 00000100:00100000:3.0:1788652402.179242:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627795584 00000100:00100000:3.0:1788652402.179327:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788652402.179336:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+9:14322:x1875537627795584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788652402.180056:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+9:14322:x1875537627795584:12345-0@lo:502:llog_process_th.0 Request processed in 711us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652402.180066:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788652402.180247:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a284000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a384a7b-92b2-4f9e-a496-63aebbb65331:14322:1875537627795584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788652402.180278:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788652402.180291:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652402.180293:0:14322:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788652402.180300:0:14322:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788652402.180303:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788652402.180320:0:14322:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8cbe4b173380) 00000020:00000080:0.0:1788652402.180341:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788652402.180346:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788652402.180495:0:14322:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788652402.180511:0:14322:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x340ed74ef02a85ab 00000020:00000080:0.0:1788652402.181006:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788652402.181011:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788652402.181016:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652402.181017:0:14322:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788652402.181020:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788652402.181023:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652402.181024:0:14322:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788652402.181028:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788652402.181038:0:14322:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8cbe4b170000) 00000020:00000080:0.0:1788652402.181115:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788652402.181183:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788652402.181186:0:14322:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788652402.181189:0:14322:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788652402.181198:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788652402.181246:0:14322:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbe48680800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788652402.181260:0:14322:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8cbe4b1719c0) 00000020:00000080:0.0:1788652402.181268:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788652402.181325:0:14322:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788652402.181331:0:14322:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x340ed74ef02a85c0 00000020:00000080:0.0:1788652402.181493:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788652402.181500:0:14322:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788652402.181505:0:14322:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x340ed74ef02a85c7 00080000:01000000:0.0:1788652402.181510:0:14322:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788652402.181514:0:14322:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x340ed74ef02a85ce 00010000:00010000:2.0:1788652402.271183:0:14322:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788652402.271581:0:14322:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1788652402.271934:0:14322:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788652402.272447:0:14322:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8cbe51343380) 00000020:00000080:2.0:1788652402.272468:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788652402.272529:0:14322:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788652402.272537:0:14322:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x340ed74ef02a85dc 00000020:00000080:0.0:1788652402.279497:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788652402.293246:0:14322:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x340ed74ef02a85e3 00000020:00000080:2.0:1788652402.295682:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788652402.295698:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652402.295719:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652402.295722:0:14322:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788652402.295726:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788652402.295729:0:14322:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788652402.295730:0:14322:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788652402.295732:0:14322:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788652402.295733:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788652402.295736:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652402.295737:0:14322:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788652402.295751:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788652402.295756:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652402.295757:0:14322:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788652402.295762:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788652402.295825:0:14322:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788652402.295839:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652402.295842:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652402.295843:0:14322:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788652402.295845:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788652402.295849:0:14322:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788652402.295852:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652402.295853:0:14322:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788652402.295865:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788652402.295871:0:14322:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.150@tcp to nid 0x20000c0a8cb96 (192.168.203.150@tcp) 00000020:01000000:2.0:1788652402.296232:0:14322:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788652402.296238:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788652402.296254:0:14322:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8cbe513419c0) 00000020:00000080:2.0:1788652402.296271:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788652402.296276:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788652402.296332:0:14322:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788652402.296338:0:14322:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788652402.296345:0:14322:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x340ed74ef02a85f1 00010000:00080000:2.0:1788652402.296376:0:14322:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbe437f1800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.150@tcp at head 00010000:00010000:2.0:1788652402.296600:0:14322:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788652402.299556:0:14322:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788652402.299599:0:14322:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788652402.301672:0:14322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788652402.302202:0:14322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788652402.302265:0:14322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788652402.302642:0:14326:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788652402.302647:0:14326:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788652402.309315:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788652402.309333:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788652402.309372:0:14322:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788652402.309395:0:14322:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x340ed74ef02a85f8 00000100:00080000:3.0:1788652402.309404:0:14322:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788652402.309411:0:14322:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cbe437f1800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1788652402.309446:0:14322:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe7f2f9c00 x1875537627795712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788652402.309480:0:14322:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788652402.309544:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652402.309548:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652402.309551:0:14322:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788652402.309554:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788652402.309557:0:14322:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1788652402.309559:0:14322:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788652402.309560:0:14322:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788652402.309576:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788652402.309578:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652402.309579:0:14322:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788652402.309582:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788652402.309587:0:14322:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788652402.309591:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652402.309593:0:14322:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788652402.309596:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788652402.309601:0:14322:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.150@tcp to nid 0x20000c0a8cb96 (192.168.203.150@tcp) 00000020:01000000:3.0:1788652402.309626:0:14322:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788652402.309629:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788652402.309641:0:14322:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8cbe7596cd40) 00000020:00000080:3.0:1788652402.309652:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788652402.309656:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788652402.309713:0:14322:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788652402.309719:0:14322:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788652402.309725:0:14322:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x340ed74ef02a8606 00010000:00080000:3.0:1788652402.309754:0:14322:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbe42d8c000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.150@tcp at head 00000100:00100000:0.0:1788652402.310244:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875537627795712:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788652402.310298:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875537627795712 offset 0 length 520: 4 00010000:00010000:3.0:1788652402.311272:0:14322:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788652402.311467:0:14322:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788652402.311491:0:14322:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788652402.313677:0:14322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788652402.313757:0:14322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788652402.313884:0:14322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788652402.315469:0:14328:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788652402.315475:0:14328:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788652402.321126:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788652402.321143:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788652402.321182:0:14322:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788652402.321206:0:14322:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x340ed74ef02a860d 00000100:00080000:3.0:1788652402.321216:0:14322:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788652402.321222:0:14322:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cbe42d8c000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1788652402.321258:0:14322:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe7f2faa00 x1875537627795840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788652402.321292:0:14322:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788652402.321355:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652402.321359:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652402.321361:0:14322:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788652402.321364:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652402.321368:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652402.321369:0:14322:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788652402.321371:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788652402.321373:0:14322:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788652402.321375:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652402.321377:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652402.321378:0:14322:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788652402.321380:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652402.321381:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652402.321382:0:14322:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788652402.321385:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788652402.321417:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2fb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a384a7b-92b2-4f9e-a496-63aebbb65331:14322:1875537627795968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788652402.321493:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652402.321531:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe48696240 going to sleep for 11 seconds 00000100:00100000:0.0:1788652402.322052:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627795968 00000100:00100000:0.0:1788652402.322059:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627795968 00000100:00100000:0.0:1788652402.322105:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788652402.322123:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+9:14322:x1875537627795968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788652402.322375:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+9:14322:x1875537627795968:12345-0@lo:502:llog_process_th.0 Request processed in 253us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652402.322383:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788652402.322422:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875537627795840:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788652402.322445:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875537627795840 offset 0 length 520: 4 00000100:00100000:3.0:1788652402.322616:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2fb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a384a7b-92b2-4f9e-a496-63aebbb65331:14322:1875537627795968:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788652402.322641:0:14322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652402.322647:0:14322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652402.322649:0:14322:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788652402.322653:0:14322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788652402.322767:0:14286:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788652402.322826:0:14286:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788652402.322848:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd11000/0x340ed74ef02a8596 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a859d expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652402.322866:0:14286:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd11000/0x340ed74ef02a8596 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a859d expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652402.322874:0:14286:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbe48680800 from 1 10000000:01000000:2.0:1788652402.322877:0:14286:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788652402.322918:0:14286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ea00/0x340ed74ef02a8614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652402.322925:0:14286:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ea00/0x340ed74ef02a8614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652402.322934:0:14286:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ea00/0x340ed74ef02a8614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652402.322950:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627796096:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788652402.322980:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652402.323000:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe49d3c300 going to sleep for 11 seconds 00000100:00100000:3.0:1788652402.323260:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627796096 00000100:00100000:3.0:1788652402.323265:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627796096 00000100:00100000:3.0:1788652402.323289:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788652402.323295:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+9:14286:x1875537627796096:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652402.323304:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652402.323323:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7a0e5e00/0x340ed74ef02a861b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a8614 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652402.323342:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7a0e5e00/0x340ed74ef02a861b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a8614 expref: 10 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652402.323352:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7a0e5e00/0x340ed74ef02a861b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a8614 expref: 10 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652402.323360:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5e00, rc 0) 00000100:00100000:3.0:1788652402.323400:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+10:14286:x1875537627796096:12345-0@lo:101:mount.lustre.0 Request processed in 104us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652402.323406:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788652402.323548:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627796096:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788652402.323561:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ea00/0x340ed74ef02a8614 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a861b expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652402.323569:0:14286:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ea00/0x340ed74ef02a8614 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a861b expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652402.324332:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627796224:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788652402.324380:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652402.324410:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe49d3c300 going to sleep for 11 seconds 00000100:00100000:3.0:1788652402.324551:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627796224 00000100:00100000:3.0:1788652402.324556:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627796224 00000100:00100000:3.0:1788652402.324581:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788652402.324588:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aafe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+10:14286:x1875537627796224:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788652402.324602:0:14298:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788652402.324608:0:14298:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788652402.324686:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aafe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+10:14286:x1875537627796224:12345-0@lo:256:mount.lustre.0 Request processed in 98us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652402.324694:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788652402.325122:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627796224:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788652402.325854:0:14286:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788652402.325927:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ea00/0x340ed74ef02a8614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a861b expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652402.325938:0:14286:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ea00/0x340ed74ef02a8614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a861b expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652402.325946:0:14286:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe48680800 from 1 10000000:01000000:2.0:1788652402.325949:0:14286:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788652402.325976:0:14286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a8622 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652402.325983:0:14286:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a8622 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652402.325992:0:14286:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a8622 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652402.326008:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627796352:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788652402.326054:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652402.326084:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe49d3c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788652402.326235:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627796352 00000100:00100000:0.0:1788652402.326240:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627796352 00000100:00100000:0.0:1788652402.326280:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788652402.326288:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aafc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+10:14286:x1875537627796352:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788652402.326297:0:14299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652402.326312:0:14299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7fd10600/0x340ed74ef02a8629 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a8622 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652402.326330:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7fd10600/0x340ed74ef02a8629 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a8622 expref: 11 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652402.326340:0:14299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7fd10600/0x340ed74ef02a8629 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a8622 expref: 11 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652402.326347:0:14299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7fd10600, rc 0) 00000100:00100000:0.0:1788652402.326384:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aafc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+11:14286:x1875537627796352:12345-0@lo:101:mount.lustre.0 Request processed in 98us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652402.326391:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788652402.326460:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627796352:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788652402.326473:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a8622 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8629 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652402.326494:0:14286:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a8622 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a8629 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652402.326541:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627796480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652402.326565:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652402.326626:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe49d3c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788652402.327584:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627796480 00000100:00100000:0.0:1788652402.327592:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627796480 00000100:00100000:0.0:1788652402.327701:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788652402.327712:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aafcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+11:14286:x1875537627796480:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652402.328131:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aafcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+11:14286:x1875537627796480:12345-0@lo:501:mount.lustre.0 Request processed in 421us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652402.328139:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788652402.328209:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627796480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652402.328252:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627796608:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788652402.328293:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652402.328328:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe49d3c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788652402.328381:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627796608 00000100:00100000:0.0:1788652402.328386:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627796608 00000100:00100000:0.0:1788652402.328412:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788652402.328420:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aafd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+11:14286:x1875537627796608:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788652402.328557:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aafd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+11:14286:x1875537627796608:12345-0@lo:503:mount.lustre.0 Request processed in 137us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652402.328564:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788652402.328639:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627796608:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788652402.330014:0:14330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a285f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a384a7b-92b2-4f9e-a496-63aebbb65331:14330:1875537627796736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788652402.330071:0:14330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652402.330159:0:14330:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe450039c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652402.330274:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627796736 00000100:00100000:0.0:1788652402.330280:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627796736 00000100:00100000:0.0:1788652402.330319:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788652402.330326:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aafc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+11:14330:x1875537627796736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788652402.330676:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aafc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+11:14330:x1875537627796736:12345-0@lo:502:llog_process_th.0 Request processed in 349us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652402.330685:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788652402.331058:0:14330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a285f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a384a7b-92b2-4f9e-a496-63aebbb65331:14330:1875537627796736:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788652402.331089:0:14330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788652402.331099:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652402.331101:0:14330:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788652402.331108:0:14330:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbe48680800 00000020:00000080:1.0:1788652402.331111:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788652402.331119:0:14330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652402.331121:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652402.331123:0:14330:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788652402.331125:0:14330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788652402.331127:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652402.331128:0:14330:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788652402.331132:0:14330:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbe48680800 00000020:00000080:1.0:1788652402.331134:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788652402.331311:0:14330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652402.331314:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652402.331316:0:14330:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788652402.331318:0:14330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788652402.331320:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652402.331322:0:14330:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788652402.331325:0:14330:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbe48680800 00000020:00000080:1.0:1788652402.331327:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788652402.331366:0:14330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a285f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a384a7b-92b2-4f9e-a496-63aebbb65331:14330:1875537627796864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788652402.331403:0:14330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652402.331577:0:14330:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe450039c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652402.331619:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627796864 00000100:00100000:0.0:1788652402.331624:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627796864 00000100:00100000:0.0:1788652402.331748:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788652402.331759:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aafdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+11:14330:x1875537627796864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788652402.331962:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aafdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+11:14330:x1875537627796864:12345-0@lo:502:llog_process_th.0 Request processed in 205us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652402.331969:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788652402.332056:0:14330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a285f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a384a7b-92b2-4f9e-a496-63aebbb65331:14330:1875537627796864:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788652402.332079:0:14330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652402.332085:0:14330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652402.332087:0:14330:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788652402.332091:0:14330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788652402.332894:0:14286:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788652402.332920:0:14286:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788652402.332936:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a8622 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8629 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652402.332949:0:14286:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a8622 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8629 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652402.333002:0:14286:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788652402.333006:0:14286:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cbe48680800 10000000:01000000:1.0:1788652402.333008:0:14286:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cbe48680800 10000000:01000000:1.0:1788652402.333013:0:14286:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788652402.333018:0:14286:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbe48680800 from 1 10000000:01000000:1.0:1788652402.333021:0:14286:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788652402.333052:0:14286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c9e00/0x340ed74ef02a8630 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652402.333059:0:14286:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c9e00/0x340ed74ef02a8630 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652402.333067:0:14286:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c9e00/0x340ed74ef02a8630 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652402.333084:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a286680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627796992:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788652402.333120:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652402.333242:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe45003240 going to sleep for 11 seconds 00000100:00100000:0.0:1788652402.333305:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627796992 00000100:00100000:0.0:1788652402.333311:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627796992 00000100:00100000:0.0:1788652402.333385:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788652402.333393:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aafc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+11:14286:x1875537627796992:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788652402.333403:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652402.333413:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7fd11600/0x340ed74ef02a8637 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a8630 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652402.333444:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7fd11600/0x340ed74ef02a8637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a8630 expref: 12 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652402.333454:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7fd11600/0x340ed74ef02a8637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a8630 expref: 12 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652402.333463:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7fd11600, rc 0) 00000100:00100000:0.0:1788652402.333498:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aafc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:14286:x1875537627796992:12345-0@lo:101:mount.lustre.0 Request processed in 106us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652402.333504:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788652402.333610:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a286680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627796992:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788652402.333623:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c9e00/0x340ed74ef02a8630 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8637 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652402.333642:0:14286:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c9e00/0x340ed74ef02a8630 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a8637 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652402.333683:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a286680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627797120:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652402.333789:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652402.333813:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe45003240 going to sleep for 11 seconds 00000100:00100000:0.0:1788652402.333902:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627797120 00000100:00100000:0.0:1788652402.333906:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627797120 00000100:00100000:0.0:1788652402.333923:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788652402.333928:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aafd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:14286:x1875537627797120:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652402.334279:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aafd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:14286:x1875537627797120:12345-0@lo:501:mount.lustre.0 Request processed in 350us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652402.334286:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788652402.334358:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a286680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627797120:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652402.334385:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a286680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627797248:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788652402.334424:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652402.334527:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe45003240 going to sleep for 11 seconds 00000100:00100000:0.0:1788652402.334562:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627797248 00000100:00100000:0.0:1788652402.334566:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627797248 00000100:00100000:0.0:1788652402.334621:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788652402.334628:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aafec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:14286:x1875537627797248:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788652402.334802:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aafec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:14286:x1875537627797248:12345-0@lo:503:mount.lustre.0 Request processed in 174us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652402.334816:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788652402.334947:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a286680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627797248:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788652402.344160:0:14333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a384a7b-92b2-4f9e-a496-63aebbb65331:14333:1875537627797376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652402.344381:0:14333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652402.344432:0:14333:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe49d3cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788652402.345149:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627797376 00000100:00100000:1.0:1788652402.345158:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627797376 00000100:00100000:1.0:1788652402.345211:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788652402.345220:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aaff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:14333:x1875537627797376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788652402.345474:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aaff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:14333:x1875537627797376:12345-0@lo:502:llog_process_th.0 Request processed in 254us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652402.345481:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788652402.346173:0:14333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a384a7b-92b2-4f9e-a496-63aebbb65331:14333:1875537627797376:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788652402.346687:0:14333:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788652402.346705:0:14333:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8cbe51344d40) 00000020:00000080:2.0:1788652402.346726:0:14333:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1788652402.347172:0:14333:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbe48680800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788652402.347178:0:14333:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbe48680800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788652402.347181:0:14333:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe48680800 4 00010000:00080000:2.0:1788652402.347334:0:14333:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbe7f669000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.150@tcp at head 00010000:00010000:2.0:1788652402.354171:0:14333:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788652402.354552:0:14333:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788652402.354588:0:14333:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788652402.354601:0:14333:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x340ed74ef02a8645 00000100:00080000:2.0:1788652402.354619:0:14333:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788652402.354626:0:14333:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cbe7f669000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1788652402.354659:0:14333:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe7f90ce00 x1875537627797504/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788652402.354685:0:14333:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788652402.357182:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875537627797504:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788652402.357276:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652402.357470:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627797504 00000100:00100000:2.0:1788652402.357480:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627797504 00000100:00100000:2.0:1788652402.357524:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788652402.357532:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1875537627797504:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788652402.357655:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1875537627797504:12345-0@lo:38:llog_process_th.0 Request processed in 122us (378us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788652402.357662:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788652402.357976:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788652402.357984:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cbe7f669000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788652402.357989:0:3302:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788652402.357993:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875537627797504:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788652402.358529:0:14333:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a384a7b-92b2-4f9e-a496-63aebbb65331:14333:1875537627797632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652402.358645:0:14333:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652402.358689:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627797632 00000100:00100000:2.0:1788652402.358690:0:14333:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe49d3ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788652402.358696:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627797632 00000100:00100000:3.0:1788652402.358881:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788652402.358891:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aaff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:14333:x1875537627797632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788652402.359289:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aaff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:14333:x1875537627797632:12345-0@lo:502:llog_process_th.0 Request processed in 398us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652402.359297:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788652402.359302:0:14333:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a384a7b-92b2-4f9e-a496-63aebbb65331:14333:1875537627797632:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788652402.359330:0:14333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788652402.359516:0:14286:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788652402.359538:0:14286:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788652402.359554:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c9e00/0x340ed74ef02a8630 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8637 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652402.359566:0:14286:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c9e00/0x340ed74ef02a8630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8637 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788652402.359610:0:14286:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788652402.359612:0:14286:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788652402.359614:0:14286:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788652402.359616:0:14286:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788652402.359617:0:14286:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788652402.359619:0:14286:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788652402.359620:0:14286:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788652402.359621:0:14286:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788652402.359623:0:14286:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788652402.359624:0:14286:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788652402.359628:0:14286:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788652402.359631:0:14286:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788652402.359632:0:14286:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788652402.359634:0:14286:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788652402.359635:0:14286:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788652402.359636:0:14286:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788652402.359637:0:14286:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788652402.359638:0:14286:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788652402.359639:0:14286:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788652402.359640:0:14286:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788652402.359641:0:14286:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788652402.359659:0:14286:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788652402.359671:0:14286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a286680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627797760:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788652402.359708:0:14286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652402.359729:0:14286:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe45003480 going to sleep for 11 seconds 00000100:00100000:1.0:1788652402.359750:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627797760 00000100:00100000:1.0:1788652402.359755:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627797760 00000100:00100000:1.0:1788652402.359796:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788652402.359804:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aaff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:14286:x1875537627797760:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788652402.359827:0:14299:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788652402.359839:0:14299:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788652402.412882:0:14299:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788652402.412903:0:14299:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788652402.413039:0:14320:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788652402.413116:0:14320:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788652402.413145:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbe7fd10800/0x340ed74ef02a864c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652402.413166:0:14320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe7a0e5e00/0x340ed74ef02a861b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a8614 expref: 12 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652402.413176:0:14320:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbe7fd10800/0x340ed74ef02a864c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652402.413216:0:14320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe7a0e5e00/0x340ed74ef02a861b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a8614 expref: 12 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652402.413233:0:14320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe7a0e5e00/0x340ed74ef02a861b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a8614 expref: 12 pid: 14297 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652402.413248:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14320:1875537627797888:0@lo:104: 00000100:00100000:0.0:1788652402.413317:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652402.413384:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b689000 going to sleep for 11 seconds 00000100:00100000:2.0:1788652402.413576:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627797888 00000100:00100000:2.0:1788652402.413583:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627797888 00000100:00100000:2.0:1788652402.413637:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788652402.413649:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a384a7b-92b2-4f9e-a496-63aebbb65331+3:14320:x1875537627797888:12345-0@lo:104: 00010000:00010000:2.0:1788652402.413663:0:14287:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ea00/0x340ed74ef02a8614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a861b expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652402.413739:0:14287:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788652402.413745:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a384a7b-92b2-4f9e-a496-63aebbb65331+3:14320:x1875537627797888:12345-0@lo:104: Request processed in 100us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652402.413752:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788652402.413826:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14320:1875537627797888:0@lo:104: 00010000:00010000:1.0:1788652402.413847:0:14320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbe7fd10800/0x340ed74ef02a864c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652402.413893:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652402.413900:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ea00/0x340ed74ef02a8614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a861b expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652402.413908:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215ea00 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:3.0:1788652402.413912:0:14293:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ea00/0x340ed74ef02a8614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a861b expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652402.413919:0:14293:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ea00/0x340ed74ef02a8614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a861b expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788652402.413926:0:14293:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ea00/0x340ed74ef02a8614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a861b expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652402.413932:0:14293:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788652402.413967:0:14293:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ea00/0x340ed74ef02a8614 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a861b expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652402.413974:0:14293:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788652402.414001:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ea00/0x340ed74ef02a8614 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a861b expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652402.414020:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ea00/0x340ed74ef02a8614 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a861b expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652402.414038:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652402.414040:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652402.414053:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652402.414119:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788652402.414130:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a384a7b-92b2-4f9e-a496-63aebbb65331:3305:1875537627798016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788652402.414160:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652402.414222:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627798016 00000100:00100000:3.0:1788652402.414227:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627798016 00010000:00010000:3.0:1788652402.414248:0:14289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe7a0e5e00/0x340ed74ef02a861b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a8614 expref: 13 pid: 14297 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652402.414278:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788652402.414285:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a285180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a384a7b-92b2-4f9e-a496-63aebbb65331+13:3305:x1875537627798016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788652402.414296:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652402.414301:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe7a0e5e00/0x340ed74ef02a861b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a8614 expref: 13 pid: 14297 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652402.414312:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe7a0e5e00/0x340ed74ef02a861b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a8614 expref: 13 pid: 14297 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652402.414325:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe7a0e5e00/0x340ed74ef02a861b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a8614 expref: 13 pid: 14297 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652402.414349:0:14289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbe7fd10800/0x340ed74ef02a864c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652402.414356:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7fd10800/0x340ed74ef02a864c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788652402.414379:0:14289:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001335725s 00010000:00010000:3.0:1788652402.414384:0:14289:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe7fd10800/0x340ed74ef02a864c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652402.414392:0:14289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe7fd10800/0x340ed74ef02a864c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652402.414398:0:14289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbe7fd10800/0x340ed74ef02a864c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652402.414405:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbe7fd10800/0x340ed74ef02a864c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652402.414423:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7fd10800 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:3.0:1788652402.414428:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbe7fd10800/0x340ed74ef02a864c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652402.414436:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbe7fd10800/0x340ed74ef02a864c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652402.414449:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbe7fd10800/0x340ed74ef02a864c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652402.414460:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788652402.414462:0:14320:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbe7fd10800/0x340ed74ef02a864c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652402.414473:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbe7fd10800/0x340ed74ef02a864c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652402.414481:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe7fd10800/0x340ed74ef02a864c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652402.414506:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a285180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:3305:x1875537627798016:12345-0@lo:103:ldlm_bl.0 Request processed in 220us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652402.414514:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788652402.414810:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a384a7b-92b2-4f9e-a496-63aebbb65331:3305:1875537627798016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788652402.421990:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aaff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+11:14286:x1875537627797760:12345-0@lo:253:mount.lustre.0 Request processed in 62179us (62273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652402.422006:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788652402.422031:0:14286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a286680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14286:1875537627797760:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788652402.422059:0:14286:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788652402.422063:0:14286:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788652402.422064:0:14286:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788652402.422066:0:14286:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788652402.422067:0:14286:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788652402.422068:0:14286:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788652402.422069:0:14286:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788652402.422070:0:14286:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788652402.422071:0:14286:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788652402.422072:0:14286:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788652402.422074:0:14286:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788652402.422093:0:14286:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788652402.427705:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788652402.427943:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788652402.428243:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788652402.428372:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788652402.428604:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788652402.428739:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788652402.430104:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788652402.430272:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788652402.430939:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788652402.431226:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788652402.431701:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788652402.433300:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1788652402.470263:0:14286:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788652402.470668:0:14286:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788652402.470972:0:14343:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788652402.470976:0:14343:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788652402.471269:0:14344:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788652402.471336:0:14344:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788652402.472892:0:14286:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788652402.473011:0:14286:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788652402.473498:0:14286:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788652402.473505:0:14286:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788652402.473615:0:14286:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788652402.475677:0:14286:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788652402.476386:0:14286:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788652402.476439:0:14286:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788652402.477068:0:14286:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:1.0:1788652402.478214:0:14286:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000040:00080000:2.0:1788652402.480408:0:14344:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788652402.480904:0:14344:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788652402.480909:0:14344:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00000004:1.0:1788652402.483050:0:14286:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788652402.514823:0:14286:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788652402.514880:0:14286:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa24681e1f988 00100000:10000000:1.0:1788652402.514890:0:14286:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788652402.515407:0:14286:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788652402.515435:0:14286:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.150@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788652402.515448:0:14286:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788652402.515467:0:14286:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788652403.017483:0:13012:0:(ldlm_pool.c:1330:ldlm_pools_recalc_task()) Negative interval(0) 00010000:00010000:3.0:1788652403.019078:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788652403.401045:0:14338:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788652403.401055:0:14338:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788652403.401459:0:14338:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788652403.401468:0:14338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:0.0:1788652403.471965:0:14301:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788652403.471973:0:14301:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbe48680800 from 6 10000000:01000000:0.0:1788652403.471979:0:14301:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788652403.472027:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10000/0x340ed74ef02a8653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652403.472038:0:14301:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10000/0x340ed74ef02a8653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652403.472055:0:14301:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10000/0x340ed74ef02a8653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652403.472083:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627798144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788652403.472149:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652403.472197:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe47e6b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788652403.472274:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627798144 00000100:00100000:3.0:1788652403.472282:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627798144 00000100:00100000:3.0:1788652403.472360:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788652403.472369:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aaffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+11:14301:x1875537627798144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652403.472381:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652403.472395:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7a0e5e00/0x340ed74ef02a865a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a8653 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652403.472417:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7a0e5e00/0x340ed74ef02a865a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a8653 expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652403.472426:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7a0e5e00/0x340ed74ef02a865a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a8653 expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652403.472435:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5e00, rc 0) 00000100:00100000:3.0:1788652403.472479:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aaffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:14301:x1875537627798144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652403.472486:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788652403.476028:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627798144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652403.476056:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10000/0x340ed74ef02a8653 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a865a expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652403.476068:0:14301:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10000/0x340ed74ef02a8653 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a865a expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652403.476136:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627798272:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788652403.476214:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652403.476257:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe47e6b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788652403.476303:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627798272 00000100:00100000:3.0:1788652403.476310:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627798272 00000100:00100000:3.0:1788652403.476359:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788652403.476368:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aafe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:14301:x1875537627798272:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788652403.476388:0:14299:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788652403.476404:0:14299:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788652403.476407:0:14299:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788652403.476503:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aafe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:14301:x1875537627798272:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652403.476512:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788652403.476581:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627798272:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788652403.476623:0:14301:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788652403.476630:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10000/0x340ed74ef02a8653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a865a expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652403.476638:0:14301:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10000/0x340ed74ef02a8653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a865a expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652404.040089:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788652404.423993:0:14338:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788652404.424003:0:14338:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788652404.424584:0:14338:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788652404.424656:0:14338:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788652404.424690:0:14338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:1.0:1788652405.065140:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652406.087937:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788652406.715097:0:14586:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788652407.117053:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788652407.431940:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652407.431946:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788652407.431949:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652407.431951:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788652407.431954:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788652407.431957:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788652407.431961:0:38:0:(import.c:65:import_set_state_nolock()) ffff8cbe7f669000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788652407.431982:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cbe7f669000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1788652407.432005:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe7f2fad80 x1875537627798528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788652407.432056:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a384a7b-92b2-4f9e-a496-63aebbb65331:3303:1875537627798400:0@lo:400:kworker.0 00000100:00100000:3.0:1788652407.432121:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652407.432181:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627798400 00000100:00100000:3.0:1788652407.432189:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627798400 00000100:00100000:3.0:1788652407.432238:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788652407.432247:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aafe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:3303:x1875537627798400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652407.432297:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aafe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:3303:x1875537627798400:12345-0@lo:400:kworker.0 Request processed in 50us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652407.432304:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788652407.432361:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a384a7b-92b2-4f9e-a496-63aebbb65331:3303:1875537627798400:0@lo:400:kworker.0 00000100:00100000:1.0:1788652407.432513:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875537627798528:0@lo:38:kworker.0 00000100:00100000:1.0:1788652407.432549:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652407.433068:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627798528 00000100:00100000:2.0:1788652407.433074:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627798528 00000100:00100000:2.0:1788652407.433096:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788652407.433102:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1875537627798528:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788652407.433125:0:14306:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:2.0:1788652407.433160:0:14306:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x340ed74ef02a8661 00000004:00100000:2.0:1788652407.433174:0:14306:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788652407.433307:0:14306:0:(import.c:65:import_set_state_nolock()) ffff8cbe7a8c7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788652407.433355:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875537627798528:12345-0@lo:38:kworker.0 Request processed in 252us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652407.433363:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788652407.433389:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cbe7f2fad80 x1875537627798528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788652417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788652407.433415:0:3302:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788652407.433422:0:3302:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788652407.433426:0:3302:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788652407.433428:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cbe7f669000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788652407.433435:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875537627798528:0@lo:38:kworker.0 00010000:00010000:3.0:1788652408.138121:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788652409.119917:0:14738:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe76a34f80 20000000:00000080:3.0:1788652409.119933:0:14738:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cbe75e61c00 uarg=0000000000000000 20000000:01000000:3.0:1788652409.119967:0:14738:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788652409.119980:0:14738:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788652409.119985:0:14738:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788652409.120718:0:14739:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788652409.121113:0:14738:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788652409.129083:0:14738:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788652409.129506:0:14738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a8668 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652409.129536:0:14738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe7fd10600/0x340ed74ef02a8629 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a8622 expref: 11 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652409.129544:0:14738:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a8668 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652409.129588:0:14738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe7fd10600/0x340ed74ef02a8629 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a8622 expref: 11 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652409.129602:0:14738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe7fd10600/0x340ed74ef02a8629 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a8622 expref: 11 pid: 14299 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652409.129617:0:14738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14738:1875537627798656:0@lo:104: 00000100:00100000:2.0:1788652409.129680:0:14738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652409.129805:0:14738:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b099cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652409.131541:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627798656 00000100:00100000:1.0:1788652409.131554:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627798656 00000100:00100000:1.0:1788652409.131896:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788652409.131908:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a384a7b-92b2-4f9e-a496-63aebbb65331+3:14738:x1875537627798656:12345-0@lo:104: 00010000:00010000:1.0:1788652409.131926:0:14287:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a8622 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a8629 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652409.132165:0:14287:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788652409.132172:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a384a7b-92b2-4f9e-a496-63aebbb65331+3:14738:x1875537627798656:12345-0@lo:104: Request processed in 268us (2492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652409.132178:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788652409.132228:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652409.132236:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a8622 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a8629 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652409.132243:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215f200 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:3.0:1788652409.132247:0:14292:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a8622 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a8629 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652409.132256:0:14292:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a8622 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a8629 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788652409.132263:0:14292:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a8622 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a8629 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652409.132268:0:14292:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788652409.132305:0:14292:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a8622 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a8629 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652409.132312:0:14292:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788652409.132331:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a8622 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a8629 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652409.132338:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a8622 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a8629 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652409.132356:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652409.132358:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652409.132371:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652409.132385:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a384a7b-92b2-4f9e-a496-63aebbb65331:3304:1875537627798784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788652409.132421:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652409.132486:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627798784 00000100:00100000:3.0:1788652409.132490:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627798784 00010000:00010000:3.0:1788652409.132509:0:14290:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe7fd10600/0x340ed74ef02a8629 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a8622 expref: 12 pid: 14299 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652409.132529:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788652409.132536:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:3304:x1875537627798784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788652409.132545:0:14290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652409.132550:0:14290:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe7fd10600/0x340ed74ef02a8629 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a8622 expref: 12 pid: 14299 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652409.132561:0:14290:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe7fd10600/0x340ed74ef02a8629 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a8622 expref: 12 pid: 14299 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652409.132579:0:14290:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a8668 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652409.132588:0:14290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a8668 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652409.132603:0:14290:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a8668 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652409.132610:0:14290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a8668 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652409.132618:0:14290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a8668 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652409.132634:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a8668 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652409.132640:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215ea00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:3.0:1788652409.132644:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a8668 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652409.132656:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a8668 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652409.132665:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a8668 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652409.132675:0:14290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652409.132705:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:3304:x1875537627798784:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652409.132712:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788652409.132748:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a384a7b-92b2-4f9e-a496-63aebbb65331:3304:1875537627798784:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788652409.134008:0:14738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe7fd10600/0x340ed74ef02a8629 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a8622 expref: 11 pid: 14299 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652409.134024:0:14738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14738:1875537627798656:0@lo:104: 00010000:00010000:2.0:1788652409.134045:0:14738:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a8668 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652409.134054:0:14738:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a8668 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652409.134060:0:14738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a8668 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652409.134066:0:14738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a8668 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652409.161893:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652410.184983:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788652411.146430:0:14301:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788652411.146436:0:14301:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe48680800 from 10 10000000:01000000:2.0:1788652411.146440:0:14301:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788652411.146486:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e200/0x340ed74ef02a866f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652411.146497:0:14301:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e200/0x340ed74ef02a866f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652411.146508:0:14301:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e200/0x340ed74ef02a866f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652411.146531:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627798912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788652411.147906:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652411.148164:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627798912 00000100:00100000:3.0:1788652411.148173:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627798912 00000100:00100000:3.0:1788652411.148222:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788652411.148232:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aafd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+11:14301:x1875537627798912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652411.148247:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652411.148266:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7a0e5400/0x340ed74ef02a8676 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a866f expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652411.148304:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7a0e5400/0x340ed74ef02a8676 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a866f expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652411.148324:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7a0e5400/0x340ed74ef02a8676 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a866f expref: 12 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652411.148335:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5400, rc 0) 00000100:00100000:3.0:1788652411.148655:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aafd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:14301:x1875537627798912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 423us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652411.148662:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788652411.148760:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe47e6b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788652411.148809:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627798912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652411.148827:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e200/0x340ed74ef02a866f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8676 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652411.148837:0:14301:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e200/0x340ed74ef02a866f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a8676 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652411.148906:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627799040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652411.148940:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652411.148960:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe43640780 going to sleep for 11 seconds 00000100:00100000:2.0:1788652411.151266:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627799040 00000100:00100000:2.0:1788652411.151280:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627799040 00000100:00100000:0.0:1788652411.151695:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788652411.151706:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81532c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:14301:x1875537627799040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788652411.152160:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81532c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:14301:x1875537627799040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 455us (3217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652411.152169:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788652411.152280:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627799040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652411.152330:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627799168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788652411.152388:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652411.152424:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe43640780 going to sleep for 11 seconds 00000100:00100000:0.0:1788652411.153539:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627799168 00000100:00100000:0.0:1788652411.153547:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627799168 00000100:00100000:0.0:1788652411.153595:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788652411.153604:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81533450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:14301:x1875537627799168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788652411.153794:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81533450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:14301:x1875537627799168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652411.153811:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788652411.154185:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627799168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788652411.155170:0:14828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788652411.155487:0:14301:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788652411.155506:0:14301:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788652411.155516:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e200/0x340ed74ef02a866f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8676 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652411.155527:0:14301:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e200/0x340ed74ef02a866f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8676 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652411.209247:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652412.232417:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652412.551883:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652402/real 1788652402] req@ffff8cbe7f2faa00 x1875537627795840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652412 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652412.551922:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbe7f2faa00 x1875537627795840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652412 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788652412.551941:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652412.551947:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788652412.551950:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652412.551953:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788652412.551977:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652402/real 1788652402] req@ffff8cbe7f2f9c00 x1875537627795712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652412 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652412.551988:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875537627799424:0@lo:400:kworker.0 00000100:00100000:1.0:1788652412.552001:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbe7f2f9c00 x1875537627795712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652412 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788652412.552018:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cbe42d8c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788652412.552033:0:3302:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788652412.552038:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875537627795840:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788652412.552044:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cbe437f1800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788652412.552050:0:3302:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788652412.552052:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652412.552057:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875537627795712:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788652412.552110:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788652412.552126:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627799424 00000100:00100000:3.0:1788652412.552131:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a384a7b-92b2-4f9e-a496-63aebbb65331:3306:1875537627799296:0@lo:400:kworker.0 00000100:00100000:1.0:1788652412.552135:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627799424 00000100:00100000:3.0:1788652412.552169:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652412.552185:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788652412.552197:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875537627799424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652412.552222:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627799296 00000100:00100000:3.0:1788652412.552228:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627799296 00000100:00100000:3.0:1788652412.552264:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788652412.552268:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875537627799424:12345-0@lo:400:kworker.0 Request processed in 70us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652412.552275:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81533850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:3306:x1875537627799296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652412.552280:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788652412.552320:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81533850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:3306:x1875537627799296:12345-0@lo:400:kworker.0 Request processed in 47us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652412.552327:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788652412.552354:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652412.552370:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788652412.552373:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cbe437f1800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788652412.552377:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 419 00000100:00080000:3.0:1788652412.552381:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788652412.552386:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cbe437f1800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1788652412.552407:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe7f2fa300 x1875537627799552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788652412.552452:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652412.552455:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788652412.552456:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cbe42d8c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788652412.552460:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 419 00000100:00080000:3.0:1788652412.552462:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788652412.552466:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cbe42d8c000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1788652412.552480:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe7f2f9880 x1875537627799680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788652412.552513:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875537627799552:0@lo:8:kworker.0 00000100:00100000:3.0:1788652412.552518:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a384a7b-92b2-4f9e-a496-63aebbb65331:3306:1875537627799296:0@lo:400:kworker.0 00010000:00080000:3.0:1788652412.552534:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cbe7f2f9500 x1875537627799424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000100:1.0:1788652412.552545:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875537627799552 offset 0 length 520: 4 00000100:00100000:3.0:1788652412.552546:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875537627799424:0@lo:400:kworker.0 00000100:00100000:1.0:1788652412.552568:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875537627799680:0@lo:8:kworker.0 00000400:00000100:1.0:1788652412.552600:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875537627799680 offset 0 length 520: 4 00010000:00010000:1.0:1788652413.256599:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788652413.432697:0:14986:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788652413.432700:0:14986:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788652413.432850:0:14986:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cbe43929800 00000020:01000004:0.0:1788652413.432867:0:14986:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788652413.432880:0:14986:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788652413.432894:0:14986:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8cbe4b174d40) 00000020:00000080:0.0:1788652413.432910:0:14986:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788652413.452151:0:14986:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788652413.452432:0:14986:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788652413.455450:0:14986:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788652413.455752:0:14986:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788652413.456152:0:14986:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788652413.456654:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 225: rc = 0 00100000:10000000:0.0:1788652413.456905:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 225: rc = 0 00100000:10000000:0.0:1788652413.457017:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 225: rc = 0 00100000:10000000:0.0:1788652413.457494:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 566: rc = 0 00100000:10000000:0.0:1788652413.458011:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 566: rc = 0 00100000:10000000:0.0:1788652413.458275:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 566: rc = 0 00100000:10000000:0.0:1788652413.458674:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 566: rc = 0 00100000:10000000:0.0:1788652413.459061:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 566: rc = 0 00100000:10000000:0.0:1788652413.459299:0:14986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 566: rc = 0 00000020:00000080:0.0:1788652413.460459:0:14986:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788652413.460471:0:14986:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788652413.460482:0:14986:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x340ed74ef02a8684 00000020:01000004:0.0:1788652413.460492:0:14986:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788652413.460515:0:14986:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.150@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788652413.460596:0:14986:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788652413.460604:0:14986:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788652413.460610:0:14986:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788652413.460634:0:14986:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8cbe7bd34d40) 00000020:00000080:0.0:1788652413.460646:0:14986:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788652413.461877:0:14986:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788652413.462081:0:14986:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788652413.462087:0:14986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788652413.463713:0:14986:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788652413.464077:0:14986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788652413.464949:0:14986:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788652413.464957:0:14986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788652413.471559:0:14986:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788652413.471739:0:14986:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788652413.471744:0:14986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788652413.472731:0:14986:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788652413.472740:0:14986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788652413.491726:0:14986:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788652413.492103:0:14986:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788652413.492110:0:14986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788652413.493484:0:14986:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788652413.493499:0:14986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788652413.494541:0:14986:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788652413.494552:0:14986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788652413.499358:0:14986:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788652413.499556:0:14986:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788652413.499562:0:14986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788652413.500316:0:14986:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788652413.500325:0:14986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788652413.545964:0:14986:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788652413.546157:0:14986:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788652413.546164:0:14986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788652413.547537:0:14986:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788652413.547548:0:14986:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788652413.548482:0:14986:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788652413.548507:0:14986:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788652413.548512:0:14986:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.150@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788652413.563383:0:14986:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.150@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788652413.563417:0:14986:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.150@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788652413.563421:0:14986:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788652413.563423:0:14986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788652413.563425:0:14986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788652413.563426:0:14986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788652413.563427:0:14986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788652413.563428:0:14986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788652413.563430:0:14986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788652413.563431:0:14986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788652413.563432:0:14986:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788652413.563436:0:14986:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788652413.563438:0:14986:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788652413.563439:0:14986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788652413.563440:0:14986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788652413.563441:0:14986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788652413.563442:0:14986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788652413.563443:0:14986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788652413.563444:0:14986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788652413.563445:0:14986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788652413.563446:0:14986:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788652413.563471:0:14986:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788652413.563491:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a284a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627799808:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788652413.563553:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652413.563660:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe45003b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788652413.567014:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627799808 00000100:00100000:0.0:1788652413.567028:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627799808 00000100:00100000:0.0:1788652413.567137:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788652413.567161:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81533050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:14986:x1875537627799808:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788652413.567196:0:14298:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788652413.567199:0:14298:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788652413.567202:0:14298:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788652413.573259:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81533050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:14986:x1875537627799808:12345-0@lo:253:mount.lustre.0 Request processed in 6092us (9697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652413.573275:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788652413.573417:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a284a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627799808:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788652413.573446:0:14986:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788652413.573450:0:14986:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788652413.573452:0:14986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788652413.573453:0:14986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788652413.573454:0:14986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788652413.573455:0:14986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788652413.573456:0:14986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788652413.573457:0:14986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788652413.573459:0:14986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788652413.573461:0:14986:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788652413.573480:0:14986:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cbe43929800 from lustre-OST0000 10000000:01000000:1.0:1788652413.573507:0:14986:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788652413.573510:0:14986:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788652413.573517:0:14986:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cbe513c3380 local copy 00010000:00010000:1.0:1788652413.573527:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10200/0x340ed74ef02a857a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8581 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652413.573737:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a284a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627799936:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652413.574033:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652413.574111:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe45003180 going to sleep for 11 seconds 00000100:00100000:3.0:1788652413.574177:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627799936 00000100:00100000:3.0:1788652413.574184:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627799936 00000100:00100000:3.0:1788652413.574274:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788652413.574283:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81533c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:14986:x1875537627799936:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652413.574468:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81533c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:14986:x1875537627799936:12345-0@lo:501:mount.lustre.0 Request processed in 185us (434us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788652413.574476:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788652413.574536:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a284a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627799936:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788652413.574554:0:14986:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788652413.574699:0:14986:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788652413.574707:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10200/0x340ed74ef02a857a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8581 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.574717:0:14986:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10200/0x340ed74ef02a857a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8581 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652413.574740:0:14986:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cbe43929800 10000000:01000000:1.0:1788652413.574751:0:14986:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788652413.574756:0:14986:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8cbe513c3380 10000000:01000000:1.0:1788652413.574758:0:14986:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788652413.574762:0:14986:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8cbe513c3380 from 1 10000000:01000000:1.0:1788652413.574765:0:14986:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788652413.574834:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c8c00/0x340ed74ef02a8692 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.574843:0:14986:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c8c00/0x340ed74ef02a8692 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.574852:0:14986:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c8c00/0x340ed74ef02a8692 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652413.574875:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a284a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627800064:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788652413.574905:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652413.575218:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe45003180 going to sleep for 11 seconds 00000100:00100000:2.0:1788652413.575301:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627800064 00000100:00100000:2.0:1788652413.575306:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627800064 00000100:00100000:2.0:1788652413.575342:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788652413.575351:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+12:14986:x1875537627800064:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788652413.575360:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652413.575374:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe8215fc00/0x340ed74ef02a8699 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a8692 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652413.575395:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe8215fc00/0x340ed74ef02a8699 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a8692 expref: 13 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652413.575407:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe8215fc00/0x340ed74ef02a8699 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a8692 expref: 13 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652413.575416:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215fc00, rc 0) 00000100:00100000:2.0:1788652413.575454:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+13:14986:x1875537627800064:12345-0@lo:101:mount.lustre.0 Request processed in 104us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652413.575460:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788652413.575574:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a284a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627800064:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788652413.575587:0:14986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c8c00/0x340ed74ef02a8692 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8699 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.575596:0:14986:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c8c00/0x340ed74ef02a8692 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a8699 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652413.575613:0:14986:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788652413.575627:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c8c00/0x340ed74ef02a8692 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8699 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.575634:0:14986:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c8c00/0x340ed74ef02a8692 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8699 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652413.575651:0:14986:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788652413.575655:0:14986:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788652413.575659:0:14986:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788652413.575661:0:14986:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788652413.575678:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c8a00/0x340ed74ef02a86a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.575684:0:14986:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c8a00/0x340ed74ef02a86a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.575691:0:14986:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c8a00/0x340ed74ef02a86a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652413.575703:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a284a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627800192:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788652413.575730:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652413.575744:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe45003180 going to sleep for 11 seconds 00000100:00100000:2.0:1788652413.575811:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627800192 00000100:00100000:2.0:1788652413.575815:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627800192 00000100:00100000:2.0:1788652413.575833:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788652413.575839:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81532850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+13:14986:x1875537627800192:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788652413.575845:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652413.576012:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a86a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a86a0 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652413.576038:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a86a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a86a0 expref: 14 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652413.576047:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe8215f800/0x340ed74ef02a86a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a86a0 expref: 14 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652413.576054:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215f800, rc 0) 00000100:00100000:2.0:1788652413.576091:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81532850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+14:14986:x1875537627800192:12345-0@lo:101:mount.lustre.0 Request processed in 252us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652413.576098:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788652413.576207:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a284a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627800192:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788652413.576218:0:14986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c8a00/0x340ed74ef02a86a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a86a7 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.576226:0:14986:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c8a00/0x340ed74ef02a86a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a86a7 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788652413.577119:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788652413.578265:0:14986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788652413.578596:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788652413.578640:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788652413.578678:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788652413.578740:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788652413.578818:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788652413.578959:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788652413.579010:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788652413.579015:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788652413.579082:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a284a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627800320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652413.579131:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652413.579237:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe450039c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652413.579279:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627800320 00000100:00100000:2.0:1788652413.579285:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627800320 00000100:00100000:2.0:1788652413.579330:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788652413.579457:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81531450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+14:14986:x1875537627800320:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652413.579817:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81531450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+14:14986:x1875537627800320:12345-0@lo:501:mount.lustre.0 Request processed in 478us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652413.579824:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788652413.579838:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a284a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627800320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652413.579888:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627800448:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788652413.579928:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652413.579956:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4943c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788652413.580008:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627800448 00000100:00100000:0.0:1788652413.580013:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627800448 00000100:00100000:0.0:1788652413.580046:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788652413.580053:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+14:14986:x1875537627800448:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788652413.580513:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+14:14986:x1875537627800448:12345-0@lo:503:mount.lustre.0 Request processed in 458us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652413.580521:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788652413.580616:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627800448:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788652413.582259:0:14986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788652413.582404:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627800576:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652413.582474:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652413.582568:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4943c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788652413.582614:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627800576 00000100:00100000:2.0:1788652413.582621:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627800576 00000100:00100000:2.0:1788652413.582706:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788652413.582716:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81530450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+14:14986:x1875537627800576:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652413.583000:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81530450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+14:14986:x1875537627800576:12345-0@lo:502:mount.lustre.0 Request processed in 285us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652413.583008:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788652413.583097:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627800576:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788652413.583361:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788652413.583413:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788652413.583450:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788652413.583502:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788652413.583538:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788652413.583571:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788652413.583621:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788652413.583658:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788652413.583696:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788652413.583745:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788652413.583821:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788652413.583895:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788652413.583929:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627800704:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652413.583978:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652413.584485:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4943c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788652413.584523:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627800704 00000100:00100000:0.0:1788652413.584529:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627800704 00000100:00100000:2.0:1788652413.584578:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788652413.584588:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81530c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+14:14986:x1875537627800704:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652413.584797:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81530c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+14:14986:x1875537627800704:12345-0@lo:502:mount.lustre.0 Request processed in 184us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652413.584805:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788652413.584938:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627800704:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788652413.585017:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788652413.585028:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788652413.586128:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788652413.586137:0:15000:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788652413.586143:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652413.586146:0:15000:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788652413.586152:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788652413.586167:0:15000:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8cbe75968000) 00000020:00000080:3.0:1788652413.586189:0:15000:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788652413.586195:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788652413.586256:0:15000:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbe43929800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788652413.586263:0:15000:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788652413.586270:0:15000:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x340ed74ef02a86b5 00010000:00010000:3.0:1788652413.593143:0:15000:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788652413.593642:0:15000:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1788652413.595750:0:15000:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788652413.598186:0:15000:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788652413.598198:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652413.598205:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652413.598207:0:15000:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788652413.598211:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788652413.598214:0:15000:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788652413.598216:0:15000:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788652413.598218:0:15000:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788652413.598219:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788652413.598222:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652413.598223:0:15000:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788652413.598226:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788652413.598229:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652413.598230:0:15000:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788652413.598233:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788652413.598235:0:15000:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788652413.598237:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652413.598239:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652413.598240:0:15000:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788652413.598242:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788652413.598244:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652413.598245:0:15000:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788652413.598249:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788652413.598308:0:15000:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652413.598312:0:15000:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652413.598313:0:15000:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788652413.598323:0:15000:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788652413.598898:0:14986:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788652413.599000:0:14986:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788652413.599020:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c8a00/0x340ed74ef02a86a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a86a7 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652413.599032:0:14986:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c8a00/0x340ed74ef02a86a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a86a7 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652413.599041:0:14986:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe43929800 from 1 10000000:01000000:3.0:1788652413.599048:0:14986:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788652413.599084:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a86bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652413.599093:0:14986:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a86bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652413.599104:0:14986:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a86bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652413.599128:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627800832:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788652413.599198:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652413.599237:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4943c540 going to sleep for 11 seconds 00000100:00100000:1.0:1788652413.600854:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627800832 00000100:00100000:1.0:1788652413.600868:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627800832 00000100:00100000:1.0:1788652413.600930:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788652413.600940:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81531050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+14:14986:x1875537627800832:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788652413.600956:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652413.600973:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7a0c9c00/0x340ed74ef02a86c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a86bc expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.600999:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7a0c9c00/0x340ed74ef02a86c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a86bc expref: 15 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.601011:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7a0c9c00/0x340ed74ef02a86c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a86bc expref: 15 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.601019:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c9c00, rc 0) 00000100:00100000:1.0:1788652413.601081:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81531050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+15:14986:x1875537627800832:12345-0@lo:101:mount.lustre.0 Request processed in 143us (1883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652413.601088:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788652413.601717:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627800832:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652413.601742:0:14986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a86bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a86c3 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652413.601752:0:14986:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a86bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a86c3 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788652413.602479:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788652413.602843:0:14986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788652413.603484:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788652413.603547:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788652413.603621:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788652413.603629:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788652413.603709:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627800960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652413.604011:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652413.604131:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4943c540 going to sleep for 11 seconds 00000100:00100000:1.0:1788652413.604177:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627800960 00000100:00100000:1.0:1788652413.604186:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627800960 00000100:00100000:1.0:1788652413.604355:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788652413.604367:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81530850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+15:14986:x1875537627800960:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652413.604612:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81530850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+15:14986:x1875537627800960:12345-0@lo:501:mount.lustre.0 Request processed in 247us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652413.604620:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788652413.604692:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627800960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652413.604738:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627801088:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788652413.604811:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652413.605169:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627801088 00000100:00100000:0.0:1788652413.605174:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627801088 00000100:00100000:0.0:1788652413.605202:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788652413.605209:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81531c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+15:14986:x1875537627801088:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788652413.605422:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81531c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+15:14986:x1875537627801088:12345-0@lo:503:mount.lustre.0 Request processed in 212us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652413.605430:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788652413.605545:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4943c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788652413.605561:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627801088:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788652413.608516:0:14986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788652413.608622:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627801216:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652413.608698:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652413.609225:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4943c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788652413.610045:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627801216 00000100:00100000:0.0:1788652413.610054:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627801216 00000100:00100000:0.0:1788652413.610137:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788652413.610147:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81530050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+15:14986:x1875537627801216:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788652413.610459:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81530050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+15:14986:x1875537627801216:12345-0@lo:502:mount.lustre.0 Request processed in 314us (1760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652413.610468:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788652413.610552:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627801216:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788652413.610887:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788652413.610953:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788652413.611006:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788652413.611040:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788652413.611070:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788652413.611113:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788652413.611148:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788652413.611180:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788652413.611216:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627801344:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652413.611265:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652413.611306:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4943c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788652413.611615:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627801344 00000100:00100000:0.0:1788652413.611620:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627801344 00000100:00100000:0.0:1788652413.611698:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788652413.611707:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81531850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+15:14986:x1875537627801344:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788652413.611931:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81531850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+15:14986:x1875537627801344:12345-0@lo:502:mount.lustre.0 Request processed in 224us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652413.611938:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788652413.612023:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627801344:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788652413.612122:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788652413.612132:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788652413.616446:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652413.616460:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652413.616462:0:15004:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788652413.616481:0:15004:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbe43929800 00000020:00000080:3.0:1788652413.616483:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788652413.616491:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652413.616494:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652413.616496:0:15004:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788652413.616498:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652413.616501:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652413.616502:0:15004:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788652413.616506:0:15004:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbe43929800 00000020:00000080:3.0:1788652413.616507:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788652413.616620:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652413.616624:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652413.616626:0:15004:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788652413.616629:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652413.616631:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652413.616633:0:15004:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788652413.616636:0:15004:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbe43929800 00000020:00000080:3.0:1788652413.616638:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788652413.618024:0:15004:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652413.618033:0:15004:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652413.618035:0:15004:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788652413.618039:0:15004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788652413.619908:0:14986:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788652413.619949:0:14986:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788652413.619964:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a86bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a86c3 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.619984:0:14986:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a86bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a86c3 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652413.620032:0:14986:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788652413.620035:0:14986:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cbe43929800 10000000:01000000:1.0:1788652413.620039:0:14986:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cbe43929800 10000000:01000000:1.0:1788652413.620042:0:14986:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788652413.620047:0:14986:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbe43929800 from 1 10000000:01000000:1.0:1788652413.620049:0:14986:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788652413.620085:0:14986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c8000/0x340ed74ef02a86ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.620093:0:14986:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c8000/0x340ed74ef02a86ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.620103:0:14986:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c8000/0x340ed74ef02a86ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652413.620126:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a286300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627801472:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788652413.620187:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652413.620225:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe45003000 going to sleep for 11 seconds 00000100:00100000:2.0:1788652413.621020:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627801472 00000100:00100000:2.0:1788652413.621029:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627801472 00000100:00100000:2.0:1788652413.621079:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788652413.621089:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+15:14986:x1875537627801472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788652413.621102:0:14299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652413.621116:0:14299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe8215fa00/0x340ed74ef02a86d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a86ca expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652413.621140:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe8215fa00/0x340ed74ef02a86d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a86ca expref: 16 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652413.621151:0:14299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe8215fa00/0x340ed74ef02a86d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a86ca expref: 16 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652413.621160:0:14299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe8215fa00, rc 0) 00000100:00100000:2.0:1788652413.621209:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:14986:x1875537627801472:12345-0@lo:101:mount.lustre.0 Request processed in 121us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652413.621215:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788652413.622459:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a286300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627801472:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788652413.622485:0:14986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c8000/0x340ed74ef02a86ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a86d1 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.622498:0:14986:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c8000/0x340ed74ef02a86ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a86d1 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788652413.623342:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788652413.624410:0:14986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788652413.624875:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788652413.624925:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788652413.625037:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788652413.625094:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788652413.625138:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788652413.625227:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788652413.625453:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788652413.625499:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788652413.625565:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788652413.625614:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788652413.625647:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788652413.625833:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788652413.625884:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788652413.625941:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788652413.626098:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788652413.626140:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788652413.626203:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788652413.626291:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788652413.626347:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788652413.626405:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788652413.626474:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788652413.626532:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788652413.626582:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788652413.626650:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788652413.630378:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788652413.630424:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788652413.632655:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788652413.633070:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788652413.633193:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788652413.633212:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788652413.634244:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a286300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627801600:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652413.634326:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652413.634370:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe45003000 going to sleep for 11 seconds 00000100:00100000:0.0:1788652413.636260:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627801600 00000100:00100000:0.0:1788652413.636275:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627801600 00000100:00100000:0.0:1788652413.636345:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788652413.636358:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:14986:x1875537627801600:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652413.636679:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:14986:x1875537627801600:12345-0@lo:501:mount.lustre.0 Request processed in 324us (2352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652413.636688:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788652413.637440:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a286300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627801600:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652413.637513:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a286300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627801728:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788652413.637569:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652413.637603:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627801728 00000100:00100000:1.0:1788652413.637608:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe45003000 going to sleep for 11 seconds 00000100:00100000:2.0:1788652413.637610:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627801728 00000100:00100000:0.0:1788652413.637821:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788652413.637832:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:14986:x1875537627801728:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788652413.638084:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:14986:x1875537627801728:12345-0@lo:503:mount.lustre.0 Request processed in 254us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652413.638092:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788652413.638148:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a286300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627801728:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788652413.640893:0:14986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788652413.640989:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a286300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627801856:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788652413.641069:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652413.641119:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4817fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652413.641212:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627801856 00000100:00100000:2.0:1788652413.641222:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627801856 00000100:00100000:2.0:1788652413.641372:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788652413.641384:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:14986:x1875537627801856:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652413.641605:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:14986:x1875537627801856:12345-0@lo:502:mount.lustre.0 Request processed in 223us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652413.641620:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788652413.641768:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a286300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627801856:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788652413.642079:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788652413.642135:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788652413.642180:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788652413.642266:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788652413.642306:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788652413.642354:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788652413.642389:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788652413.642422:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788652413.642475:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788652413.642503:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788652413.642527:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788652413.642565:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788652413.642616:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788652413.642746:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788652413.642832:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788652413.642869:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788652413.642889:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788652413.642920:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788652413.642954:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788652413.642987:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788652413.643036:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788652413.643077:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788652413.643112:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788652413.643172:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788652413.643213:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788652413.643253:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788652413.643323:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788652413.643372:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788652413.643420:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788652413.643490:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788652413.643522:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788652413.643558:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788652413.643613:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788652413.643764:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788652413.643859:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788652413.643932:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788652413.643972:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788652413.644008:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788652413.644065:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788652413.644114:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788652413.644170:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a286300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627801984:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788652413.644246:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652413.644286:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe45003000 going to sleep for 11 seconds 00000100:00100000:2.0:1788652413.644761:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627801984 00000100:00100000:2.0:1788652413.644808:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627801984 00000100:00100000:2.0:1788652413.644857:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788652413.644867:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:14986:x1875537627801984:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652413.645091:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:14986:x1875537627801984:12345-0@lo:502:mount.lustre.0 Request processed in 225us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652413.645099:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788652413.645213:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a286300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627801984:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788652413.645304:0:14986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788652413.645315:0:14986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788652413.648312:0:15009:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788652413.648330:0:15009:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8cbe51340000) 00000020:00000080:2.0:1788652413.648351:0:15009:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788652413.648436:0:15009:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbe43929800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788652413.648441:0:15009:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbe43929800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788652413.648444:0:15009:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe43929800 3 00010000:00080000:2.0:1788652413.648474:0:15009:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbe81a20800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.150@tcp at head 00010000:00010000:2.0:1788652413.652885:0:15009:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788652413.653352:0:15009:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788652413.653388:0:15009:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788652413.653400:0:15009:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x340ed74ef02a86df 00000100:00080000:2.0:1788652413.653411:0:15009:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788652413.653417:0:15009:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cbe81a20800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1788652413.653451:0:15009:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe7f90f100 x1875537627802112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788652413.653557:0:15009:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788652413.653668:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652413.653673:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788652413.653675:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652413.653686:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788652413.653734:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627802240:0@lo:400:kworker.0 00000100:00100000:1.0:1788652413.653735:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875537627802112:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788652413.653934:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652413.654024:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627802112 00000100:00100000:2.0:1788652413.654032:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627802112 00000100:00100000:2.0:1788652413.654067:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788652413.654083:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1875537627802112:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788652413.654106:0:14304:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:2.0:1788652413.654228:0:14304:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x340ed74ef02a86e6 00000004:00100000:2.0:1788652413.654242:0:14304:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1788652413.654244:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788652413.654340:0:14304:0:(import.c:65:import_set_state_nolock()) ffff8cbe81a25800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788652413.654432:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875537627802112:12345-0@lo:38:llog_process_th.0 Request processed in 349us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652413.654440:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788652413.654544:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cbe7f90f100 x1875537627802112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788652423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652413.654559:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788652413.654566:0:3302:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788652413.654572:0:3302:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788652413.654576:0:3302:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788652413.654578:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cbe81a20800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788652413.654584:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875537627802112:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788652413.654628:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627802240 00000100:00100000:2.0:1788652413.654632:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627802240 00000100:00100000:2.0:1788652413.654729:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788652413.654738:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627802240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652413.654818:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627802240:12345-0@lo:400:kworker.0 Request processed in 81us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652413.654824:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788652413.654919:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cbe5f8f9500 x1875537627802240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652413.654928:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627802240:0@lo:400:kworker.0 00000040:00080000:1.0:1788652413.656289:0:15009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788652413.656385:0:14986:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788652413.656415:0:14986:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788652413.656431:0:14986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c8000/0x340ed74ef02a86ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a86d1 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.656443:0:14986:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0c8000/0x340ed74ef02a86ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a86d1 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788652413.656495:0:14986:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788652413.656497:0:14986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788652413.656499:0:14986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788652413.656500:0:14986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788652413.656501:0:14986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788652413.656503:0:14986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788652413.656504:0:14986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788652413.656506:0:14986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788652413.656507:0:14986:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788652413.656511:0:14986:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788652413.656513:0:14986:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788652413.656515:0:14986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788652413.656516:0:14986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788652413.656517:0:14986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788652413.656523:0:14986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788652413.656524:0:14986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788652413.656525:0:14986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788652413.656526:0:14986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788652413.656527:0:14986:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788652413.656550:0:14986:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788652413.656569:0:14986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a287b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627802368:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788652413.656637:0:14986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652413.656686:0:14986:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4817fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652413.657623:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627802368 00000100:00100000:2.0:1788652413.657633:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627802368 00000100:00100000:2.0:1788652413.657676:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788652413.657686:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:14986:x1875537627802368:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788652413.657725:0:14299:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788652413.657740:0:14299:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788652413.706809:0:14299:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788652413.706831:0:14299:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788652413.707487:0:14320:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788652413.707493:0:14320:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788652413.707515:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbe7a0e4400/0x340ed74ef02a86ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652413.707659:0:14320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe7a0e5e00/0x340ed74ef02a865a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a8653 expref: 16 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652413.707669:0:14320:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbe7a0e4400/0x340ed74ef02a86ed lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652413.707709:0:14320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe7a0e5e00/0x340ed74ef02a865a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a8653 expref: 16 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652413.707737:0:14320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe7a0e5e00/0x340ed74ef02a865a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a8653 expref: 16 pid: 14298 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652413.707752:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14320:1875537627802496:0@lo:104: 00000100:00100000:3.0:1788652413.707861:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652413.707920:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4f38ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788652413.708409:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627802496 00000100:00100000:1.0:1788652413.708418:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627802496 00000100:00100000:1.0:1788652413.708473:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788652413.708482:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4a384a7b-92b2-4f9e-a496-63aebbb65331+3:14320:x1875537627802496:12345-0@lo:104: 00010000:00010000:1.0:1788652413.708497:0:14288:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10000/0x340ed74ef02a8653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a865a expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.708635:0:14288:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788652413.708641:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4a384a7b-92b2-4f9e-a496-63aebbb65331+3:14320:x1875537627802496:12345-0@lo:104: Request processed in 161us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652413.708648:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788652413.708691:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14320:1875537627802496:0@lo:104: 00010000:00010000:1.0:1788652413.708713:0:14320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbe7a0e4400/0x340ed74ef02a86ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.708731:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652413.708737:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10000/0x340ed74ef02a8653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a865a expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.708745:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7fd10000 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:1.0:1788652413.708750:0:14292:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10000/0x340ed74ef02a8653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a865a expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.708798:0:14292:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10000/0x340ed74ef02a8653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a865a expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788652413.708808:0:14292:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10000/0x340ed74ef02a8653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a865a expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652413.708814:0:14292:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788652413.708847:0:14292:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10000/0x340ed74ef02a8653 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a865a expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.708854:0:14292:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788652413.708873:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10000/0x340ed74ef02a8653 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a865a expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.708881:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10000/0x340ed74ef02a8653 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a865a expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.708897:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652413.708900:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652413.708901:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652413.708909:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788652413.708922:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a384a7b-92b2-4f9e-a496-63aebbb65331:3303:1875537627802624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788652413.708953:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652413.708991:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627802624 00000100:00100000:1.0:1788652413.708995:0:14291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627802624 00010000:00010000:1.0:1788652413.709014:0:14291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe7a0e5e00/0x340ed74ef02a865a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a8653 expref: 17 pid: 14298 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652413.709038:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788652413.709052:0:14291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a286d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a384a7b-92b2-4f9e-a496-63aebbb65331+17:3303:x1875537627802624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788652413.709064:0:14291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652413.709070:0:14291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe7a0e5e00/0x340ed74ef02a865a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a8653 expref: 17 pid: 14298 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.709081:0:14291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe7a0e5e00/0x340ed74ef02a865a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a8653 expref: 17 pid: 14298 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.709095:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe7a0e5e00/0x340ed74ef02a865a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a8653 expref: 17 pid: 14298 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.709109:0:14291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbe7a0e4400/0x340ed74ef02a86ed lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.709118:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7a0e4400/0x340ed74ef02a86ed lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788652413.709132:0:14291:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001639346s 00010000:00010000:1.0:1788652413.709137:0:14291:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe7a0e4400/0x340ed74ef02a86ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.709144:0:14291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe7a0e4400/0x340ed74ef02a86ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.709151:0:14291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbe7a0e4400/0x340ed74ef02a86ed lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.709157:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbe7a0e4400/0x340ed74ef02a86ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.709162:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4400 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:1.0:1788652413.709172:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbe7a0e4400/0x340ed74ef02a86ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.709180:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbe7a0e4400/0x340ed74ef02a86ed lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.709193:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbe7a0e4400/0x340ed74ef02a86ed lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.709203:0:14291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652413.709233:0:14291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a286d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:3303:x1875537627802624:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652413.709242:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788652413.709271:0:14320:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbe7a0e4400/0x340ed74ef02a86ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.709279:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbe7a0e4400/0x340ed74ef02a86ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652413.709285:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe7a0e4400/0x340ed74ef02a86ed lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652413.709311:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a384a7b-92b2-4f9e-a496-63aebbb65331:3303:1875537627802624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652413.719068:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+15:14986:x1875537627802368:12345-0@lo:253:mount.lustre.0 Request processed in 61375us (62423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652413.719082:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788652413.720673:0:14986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a287b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:14986:1875537627802368:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788652413.720691:0:14986:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788652413.720695:0:14986:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788652413.720697:0:14986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788652413.720698:0:14986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788652413.720700:0:14986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788652413.720701:0:14986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788652413.720702:0:14986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788652413.720717:0:14986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788652413.720719:0:14986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788652413.720720:0:14986:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788652413.720739:0:14986:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788652413.731046:0:14986:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788652413.731284:0:14986:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788652413.731462:0:14986:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788652413.731615:0:14986:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788652413.731831:0:14986:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788652413.732071:0:14986:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788652413.733211:0:14986:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788652413.777435:0:14986:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788652413.777455:0:14986:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788652413.777486:0:14986:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788652413.777539:0:14986:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.150@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788652413.777552:0:14986:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788652413.777577:0:14986:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788652414.280923:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788652414.671201:0:14338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788652414.792693:0:14301:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788652414.792702:0:14301:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbe48680800 from 7 10000000:01000000:2.0:1788652414.792707:0:14301:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788652414.792752:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a86f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652414.792764:0:14301:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a86f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652414.792811:0:14301:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a86f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652414.792837:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627802752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788652414.792906:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652414.792957:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5138ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652414.792993:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627802752 00000100:00100000:1.0:1788652414.793002:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627802752 00000100:00100000:1.0:1788652414.793048:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788652414.793057:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+15:14301:x1875537627802752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788652414.793070:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652414.793083:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7a0c9200/0x340ed74ef02a86fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a86f4 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652414.793107:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7a0c9200/0x340ed74ef02a86fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a86f4 expref: 16 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652414.793118:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7a0c9200/0x340ed74ef02a86fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a86f4 expref: 16 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652414.793127:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c9200, rc 0) 00000100:00100000:1.0:1788652414.793181:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:14301:x1875537627802752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652414.793188:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788652414.793263:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627802752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788652414.793277:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a86f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a86fb expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652414.793286:0:14301:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a86f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a86fb expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652414.793342:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627802880:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788652414.793374:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652414.793403:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5138ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652414.793451:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627802880 00000100:00100000:3.0:1788652414.793456:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627802880 00000100:00100000:3.0:1788652414.793488:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788652414.793496:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:14301:x1875537627802880:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788652414.793522:0:14299:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788652414.793538:0:14299:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788652414.793541:0:14299:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788652414.793629:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:14301:x1875537627802880:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652414.793635:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788652414.793739:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627802880:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788652414.793830:0:14301:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788652414.793837:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a86f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a86fb expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652414.793845:0:14301:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a86f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a86fb expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652415.309557:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652416.327965:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652417.351967:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652418.376241:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652418.696978:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1788652418.696999:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788652418.697004:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788652418.697007:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788652418.697010:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788652418.697028:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788652418.697045:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875537627803136:0@lo:400:kworker.0 00000100:00100000:3.0:1788652418.697114:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652418.697183:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627803136 00000100:00100000:3.0:1788652418.697203:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627803136 00000100:00100000:3.0:1788652418.697251:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788652418.697260:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875537627803136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652418.697310:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875537627803136:12345-0@lo:400:kworker.0 Request processed in 50us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652418.697317:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788652418.697366:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe7f90f100 x1875537627803136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652418.697380:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875537627803136:0@lo:400:kworker.0 00000100:00100000:0.0:1788652418.698541:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a384a7b-92b2-4f9e-a496-63aebbb65331:3306:1875537627803008:0@lo:400:kworker.0 00000100:00100000:0.0:1788652418.698599:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652418.701497:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627803008 00000100:00100000:3.0:1788652418.701511:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627803008 00000100:00100000:3.0:1788652418.701573:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788652418.701584:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:3306:x1875537627803008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652418.701682:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:3306:x1875537627803008:12345-0@lo:400:kworker.0 Request processed in 100us (3082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652418.701689:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788652418.701799:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627803264:0@lo:400:kworker.0 00000100:00100000:3.0:1788652418.701836:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652418.702269:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a384a7b-92b2-4f9e-a496-63aebbb65331:3306:1875537627803008:0@lo:400:kworker.0 00000100:00100000:2.0:1788652418.702299:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627803264 00000100:00100000:2.0:1788652418.702303:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627803264 00000100:00100000:2.0:1788652418.702431:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788652418.702440:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627803264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652418.702486:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627803264:12345-0@lo:400:kworker.0 Request processed in 48us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652418.702493:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788652418.702532:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe7f2f9500 x1875537627803264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652418.702544:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627803264:0@lo:400:kworker.0 00000100:00080000:3.0:1788652418.702734:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1788652419.282122:0:15353:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788652419.405452:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652420.423921:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652421.448233:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652422.475484:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652423.501575:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788652423.817555:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652423.817562:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788652423.817564:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652423.817578:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788652423.817628:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a384a7b-92b2-4f9e-a496-63aebbb65331:3304:1875537627803392:0@lo:400:kworker.0 00000100:00100000:0.0:1788652423.817701:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652423.817798:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627803392 00000100:00100000:0.0:1788652423.817805:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627803392 00000100:00100000:0.0:1788652423.817848:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788652423.817857:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:3304:x1875537627803392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652423.817903:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:3304:x1875537627803392:12345-0@lo:400:kworker.0 Request processed in 47us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652423.817910:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788652423.817954:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a384a7b-92b2-4f9e-a496-63aebbb65331:3304:1875537627803392:0@lo:400:kworker.0 00000100:00100000:2.0:1788652423.819099:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875537627803520:0@lo:400:kworker.0 00000100:00100000:2.0:1788652423.819152:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652423.819189:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788652423.819196:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627803648:0@lo:400:kworker.0 00000100:00100000:2.0:1788652423.819219:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652423.819256:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627803520 00000100:00100000:2.0:1788652423.819261:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627803520 00000100:00100000:2.0:1788652423.819296:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627803648 00000100:00100000:2.0:1788652423.819299:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627803648 00000100:00100000:2.0:1788652423.819326:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788652423.819333:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875537627803520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652423.819377:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875537627803520:12345-0@lo:400:kworker.0 Request processed in 45us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652423.820833:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788652423.820870:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788652423.820884:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627803648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652423.821029:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627803648:12345-0@lo:400:kworker.0 Request processed in 151us (1808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652423.821035:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788652423.821064:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788652423.821095:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe5f8fad80 x1875537627803648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652423.821108:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627803648:0@lo:400:kworker.0 00010000:00080000:2.0:1788652423.821121:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe5f8fb480 x1875537627803520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652423.821130:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875537627803520:0@lo:400:kworker.0 00010000:00010000:2.0:1788652424.521047:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788652424.904413:0:14338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1788652425.161400:0:15703:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788652425.161404:0:15703:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788652425.161600:0:15703:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cbe81a27800 00000020:01000004:2.0:1788652425.161615:0:15703:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788652425.161627:0:15703:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788652425.161655:0:15703:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8cbd433419c0) 00000020:00000080:2.0:1788652425.161671:0:15703:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788652425.176432:0:15703:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788652425.177208:0:15703:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788652425.178217:0:15703:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788652425.178445:0:15703:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788652425.178757:0:15703:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788652425.179266:0:15703:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 205: rc = 0 00100000:10000000:2.0:1788652425.179364:0:15703:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 205: rc = 0 00100000:10000000:2.0:1788652425.179462:0:15703:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 205: rc = 0 00100000:10000000:2.0:1788652425.180401:0:15703:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 562: rc = 0 00100000:10000000:2.0:1788652425.180752:0:15703:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 562: rc = 0 00100000:10000000:2.0:1788652425.181113:0:15703:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 562: rc = 0 00100000:10000000:2.0:1788652425.183897:0:15703:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 562: rc = 0 00100000:10000000:2.0:1788652425.184187:0:15703:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 562: rc = 0 00100000:10000000:2.0:1788652425.184716:0:15703:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 562: rc = 0 00000020:00000080:2.0:1788652425.185444:0:15703:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788652425.185457:0:15703:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788652425.185468:0:15703:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x340ed74ef02a8709 00000020:01000004:2.0:1788652425.185476:0:15703:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788652425.185498:0:15703:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.150@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788652425.185502:0:15703:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.150@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788652425.185516:0:15703:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788652425.185537:0:15703:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788652425.185541:0:15703:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.150@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788652425.195140:0:15703:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.150@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788652425.195177:0:15703:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.150@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788652425.195182:0:15703:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788652425.195184:0:15703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788652425.195185:0:15703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788652425.195187:0:15703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788652425.195188:0:15703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788652425.195189:0:15703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788652425.195191:0:15703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788652425.195193:0:15703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788652425.195194:0:15703:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788652425.195198:0:15703:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788652425.195200:0:15703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788652425.195202:0:15703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788652425.195208:0:15703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788652425.195209:0:15703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788652425.195209:0:15703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788652425.195210:0:15703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788652425.195211:0:15703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788652425.195212:0:15703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788652425.195213:0:15703:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788652425.195242:0:15703:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788652425.195264:0:15703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627803776:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788652425.197733:0:15703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652425.197802:0:15703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe45180900 going to sleep for 11 seconds 00000100:00100000:2.0:1788652425.197803:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627803776 00000100:00100000:2.0:1788652425.197812:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627803776 00000100:00100000:2.0:1788652425.197865:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788652425.197876:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:15703:x1875537627803776:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788652425.197934:0:14299:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788652425.197938:0:14299:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788652425.197942:0:14299:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788652425.208728:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:15703:x1875537627803776:12345-0@lo:253:mount.lustre.0 Request processed in 10845us (10989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652425.208751:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788652425.208895:0:15703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627803776:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788652425.208921:0:15703:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788652425.208926:0:15703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788652425.208927:0:15703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788652425.208928:0:15703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788652425.208930:0:15703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788652425.208931:0:15703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788652425.208932:0:15703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788652425.208934:0:15703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788652425.208935:0:15703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788652425.208937:0:15703:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788652425.208960:0:15703:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cbe81a27800 from lustre-OST0001 10000000:01000000:3.0:1788652425.208988:0:15703:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788652425.208991:0:15703:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788652425.208999:0:15703:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cbe513c3380 local copy 00010000:00010000:3.0:1788652425.209010:0:15703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10200/0x340ed74ef02a857a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8581 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652425.209247:0:15703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627803904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652425.209297:0:15703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652425.209336:0:15703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4953f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788652425.210264:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627803904 00000100:00100000:2.0:1788652425.210274:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627803904 00000100:00100000:2.0:1788652425.210328:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788652425.210338:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:15703:x1875537627803904:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652425.210750:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:15703:x1875537627803904:12345-0@lo:501:mount.lustre.0 Request processed in 412us (1450us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788652425.210759:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788652425.211193:0:15703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627803904:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788652425.211223:0:15703:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.150@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788652425.211591:0:15703:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.150@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788652425.211601:0:15703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10200/0x340ed74ef02a857a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8581 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652425.211613:0:15703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe7fd10200/0x340ed74ef02a857a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8581 expref: -99 pid: 14286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652425.211640:0:15703:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cbe81a27800 10000000:01000000:3.0:1788652425.211645:0:15703:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788652425.211650:0:15703:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788652425.211653:0:15703:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788652425.211658:0:15703:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788652425.211661:0:15703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788652425.211691:0:15703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e5c00/0x340ed74ef02a8710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652425.211700:0:15703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e5c00/0x340ed74ef02a8710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652425.211725:0:15703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e5c00/0x340ed74ef02a8710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652425.211744:0:15703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627804032:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788652425.211819:0:15703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652425.211917:0:15703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4953f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788652425.214193:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627804032 00000100:00100000:0.0:1788652425.214211:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627804032 00000100:00100000:0.0:1788652425.214721:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788652425.214734:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:15703:x1875537627804032:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788652425.214752:0:14299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652425.214791:0:14299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7fd11200/0x340ed74ef02a8717 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a8710 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652425.214823:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7fd11200/0x340ed74ef02a8717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a8710 expref: 17 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652425.214835:0:14299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7fd11200/0x340ed74ef02a8717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a8710 expref: 17 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652425.214862:0:14299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7fd11200, rc 0) 00000100:00100000:0.0:1788652425.214961:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+17:15703:x1875537627804032:12345-0@lo:101:mount.lustre.0 Request processed in 230us (3141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652425.214969:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788652425.215084:0:15703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627804032:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652425.215104:0:15703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e5c00/0x340ed74ef02a8710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8717 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652425.215122:0:15703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e5c00/0x340ed74ef02a8710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a8717 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788652425.216243:0:15703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788652425.217229:0:15703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788652425.218820:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788652425.218880:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788652425.218911:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788652425.218959:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788652425.218995:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788652425.222681:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788652425.222893:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788652425.222902:0:15703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788652425.223010:0:15703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627804160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652425.224670:0:15703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652425.224751:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627804160 00000100:00100000:2.0:1788652425.224761:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627804160 00000100:00100000:2.0:1788652425.224831:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788652425.224841:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f930850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+17:15703:x1875537627804160:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652425.225339:0:15703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4953f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788652425.225459:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f930850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+17:15703:x1875537627804160:12345-0@lo:501:mount.lustre.0 Request processed in 618us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652425.225468:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788652425.225519:0:15703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627804160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652425.225566:0:15703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627804288:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788652425.225610:0:15703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652425.225632:0:15703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4953f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788652425.225678:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627804288 00000100:00100000:0.0:1788652425.225683:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627804288 00000100:00100000:0.0:1788652425.225730:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788652425.225737:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+17:15703:x1875537627804288:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788652425.228889:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+17:15703:x1875537627804288:12345-0@lo:503:mount.lustre.0 Request processed in 3141us (3267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652425.228905:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788652425.229066:0:15703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627804288:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788652425.231580:0:15703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788652425.231700:0:15703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627804416:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652425.231811:0:15703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652425.231923:0:15703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4953f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788652425.231981:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627804416 00000100:00100000:2.0:1788652425.231989:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627804416 00000100:00100000:2.0:1788652425.232152:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788652425.232164:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f930050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+17:15703:x1875537627804416:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652425.232698:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f930050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+17:15703:x1875537627804416:12345-0@lo:502:mount.lustre.0 Request processed in 535us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652425.232715:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788652425.232828:0:15703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627804416:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788652425.233194:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788652425.234163:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788652425.234205:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788652425.234280:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788652425.234320:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788652425.234354:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788652425.234817:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788652425.234862:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788652425.234914:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788652425.234970:0:15703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627804544:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652425.235144:0:15703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652425.235334:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627804544 00000100:00100000:0.0:1788652425.235343:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627804544 00000100:00100000:0.0:1788652425.235982:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788652425.235998:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f933850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+17:15703:x1875537627804544:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788652425.236284:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f933850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+17:15703:x1875537627804544:12345-0@lo:502:mount.lustre.0 Request processed in 291us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652425.236292:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788652425.236352:0:15703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4953f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788652425.236391:0:15703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627804544:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788652425.236491:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788652425.236503:0:15703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788652425.237423:0:15704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788652425.237433:0:15704:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788652425.237440:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652425.237442:0:15704:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788652425.237447:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788652425.237461:0:15704:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8cbe759699c0) 00000020:00000080:3.0:1788652425.237484:0:15704:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788652425.237491:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788652425.237552:0:15704:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbe81a27800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788652425.237560:0:15704:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788652425.237567:0:15704:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x340ed74ef02a8725 00010000:00010000:3.0:1788652425.242380:0:15704:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788652425.243173:0:15704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1788652425.245599:0:15704:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788652425.247472:0:15704:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788652425.247494:0:15704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652425.247501:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652425.247503:0:15704:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788652425.247511:0:15704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788652425.247514:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652425.247516:0:15704:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788652425.247519:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788652425.247520:0:15704:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788652425.247523:0:15704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652425.247525:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652425.247526:0:15704:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788652425.247528:0:15704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788652425.247531:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652425.247532:0:15704:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788652425.247535:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788652425.247590:0:15704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652425.247594:0:15704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652425.247596:0:15704:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788652425.247600:0:15704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788652425.247766:0:15703:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788652425.247815:0:15703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788652425.247834:0:15703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e5c00/0x340ed74ef02a8710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8717 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652425.247844:0:15703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e5c00/0x340ed74ef02a8710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8717 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652425.247851:0:15703:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe81a27800 from 1 10000000:01000000:2.0:1788652425.247854:0:15703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788652425.247888:0:15703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a872c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652425.247896:0:15703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a872c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652425.247905:0:15703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a872c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652425.248175:0:15703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627804672:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788652425.248244:0:15703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652425.248333:0:15703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b6890c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652425.249042:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627804672 00000100:00100000:0.0:1788652425.249052:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627804672 00000100:00100000:0.0:1788652425.249103:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788652425.249113:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+17:15703:x1875537627804672:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788652425.249127:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652425.249143:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7fd10800/0x340ed74ef02a8733 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a872c expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652425.249184:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7fd10800/0x340ed74ef02a8733 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a872c expref: 18 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652425.249194:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7fd10800/0x340ed74ef02a8733 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a872c expref: 18 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652425.249202:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7fd10800, rc 0) 00000100:00100000:1.0:1788652425.249476:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+18:15703:x1875537627804672:12345-0@lo:101:mount.lustre.0 Request processed in 363us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652425.249484:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788652425.249678:0:15703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627804672:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788652425.249695:0:15703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a872c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8733 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652425.249718:0:15703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a872c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a8733 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788652425.251431:0:15703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788652425.251799:0:15703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788652425.253183:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788652425.253262:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788652425.253341:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788652425.253349:0:15703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788652425.253459:0:15703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a287b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627804800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652425.253525:0:15703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652425.253577:0:15703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe47e11cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652425.253725:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627804800 00000100:00100000:0.0:1788652425.253733:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627804800 00000100:00100000:0.0:1788652425.253805:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788652425.253817:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f932850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+18:15703:x1875537627804800:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652425.254040:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f932850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+18:15703:x1875537627804800:12345-0@lo:501:mount.lustre.0 Request processed in 225us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652425.254048:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788652425.254309:0:15703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a287b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627804800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652425.254345:0:15703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a287b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627804928:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788652425.254391:0:15703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652425.254409:0:15703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe47e11cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652425.254462:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627804928 00000100:00100000:0.0:1788652425.254467:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627804928 00000100:00100000:0.0:1788652425.254496:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788652425.254502:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f932c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+18:15703:x1875537627804928:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788652425.254643:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f932c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+18:15703:x1875537627804928:12345-0@lo:503:mount.lustre.0 Request processed in 140us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652425.254650:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788652425.254731:0:15703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a287b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627804928:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788652425.255409:0:15703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788652425.255472:0:15703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627805056:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652425.255519:0:15703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652425.255547:0:15703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe47da46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652425.255613:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627805056 00000100:00100000:0.0:1788652425.255619:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627805056 00000100:00100000:0.0:1788652425.255653:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788652425.255660:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f933050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+18:15703:x1875537627805056:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788652425.255825:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f933050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+18:15703:x1875537627805056:12345-0@lo:502:mount.lustre.0 Request processed in 166us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652425.255832:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788652425.256191:0:15703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627805056:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788652425.256438:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788652425.256493:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788652425.256543:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788652425.256579:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788652425.256613:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788652425.256672:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788652425.256723:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788652425.256765:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788652425.256832:0:15703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627805184:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652425.256881:0:15703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652425.257151:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627805184 00000100:00100000:1.0:1788652425.257157:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627805184 00000100:00100000:1.0:1788652425.257201:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788652425.257210:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+18:15703:x1875537627805184:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788652425.257369:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+18:15703:x1875537627805184:12345-0@lo:502:mount.lustre.0 Request processed in 160us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652425.257377:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788652425.257549:0:15703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe47da46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652425.257566:0:15703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627805184:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788652425.257659:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788652425.257669:0:15703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788652425.258891:0:15708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788652425.258903:0:15708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652425.258905:0:15708:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788652425.258984:0:15708:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbe81a27800 00000020:00000080:0.0:1788652425.260889:0:15708:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788652425.260971:0:15708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788652425.260978:0:15708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652425.260979:0:15708:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788652425.260985:0:15708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788652425.260988:0:15708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652425.260989:0:15708:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788652425.261112:0:15708:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cbe81a27800 00000020:00000080:0.0:1788652425.261115:0:15708:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788652425.261203:0:15708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788652425.261207:0:15708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652425.261209:0:15708:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788652425.261212:0:15708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788652425.261214:0:15708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652425.261215:0:15708:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788652425.261219:0:15708:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cbe81a27800 00000020:00000080:0.0:1788652425.261227:0:15708:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788652425.266872:0:15708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788652425.266884:0:15708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652425.266886:0:15708:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788652425.266892:0:15708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788652425.268843:0:15703:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788652425.268880:0:15703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788652425.268905:0:15703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a872c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8733 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652425.268929:0:15703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a872c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8733 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652425.268982:0:15703:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788652425.268985:0:15703:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cbe81a27800 10000000:01000000:2.0:1788652425.268989:0:15703:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cbe81a27800 10000000:01000000:2.0:1788652425.268994:0:15703:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788652425.268999:0:15703:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cbe81a27800 from 1 10000000:01000000:2.0:1788652425.269002:0:15703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788652425.269037:0:15703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f400/0x340ed74ef02a873a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652425.269045:0:15703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f400/0x340ed74ef02a873a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652425.269057:0:15703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f400/0x340ed74ef02a873a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652425.269083:0:15703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627805312:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788652425.269164:0:15703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652425.269204:0:15703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b6890c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652425.271331:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627805312 00000100:00100000:3.0:1788652425.271344:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627805312 00000100:00100000:3.0:1788652425.271402:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788652425.271413:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+18:15703:x1875537627805312:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652425.271433:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652425.271452:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7a0e4400/0x340ed74ef02a8741 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a873a expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652425.271492:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7a0e4400/0x340ed74ef02a8741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a873a expref: 19 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652425.271504:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7a0e4400/0x340ed74ef02a8741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a873a expref: 19 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652425.271516:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e4400, rc 0) 00000100:00100000:3.0:1788652425.271595:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:15703:x1875537627805312:12345-0@lo:101:mount.lustre.0 Request processed in 182us (2430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652425.271603:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788652425.271665:0:15703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627805312:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788652425.271687:0:15703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f400/0x340ed74ef02a873a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8741 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652425.271700:0:15703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f400/0x340ed74ef02a873a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a8741 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788652425.272603:0:15703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788652425.273347:0:15703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788652425.273668:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788652425.273741:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788652425.273809:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788652425.273885:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788652425.273938:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788652425.274000:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788652425.274043:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788652425.274083:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788652425.274148:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788652425.274194:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788652425.274237:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788652425.274311:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788652425.274353:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788652425.274392:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788652425.274451:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788652425.274503:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788652425.274551:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788652425.274604:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788652425.274653:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788652425.275297:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788652425.275366:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788652425.275435:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788652425.275486:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788652425.275558:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788652425.275628:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788652425.275695:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788652425.276491:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788652425.276567:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788652425.276648:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788652425.277090:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1788652425.277343:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1788652425.277424:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1788652425.277496:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1788652425.277595:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1788652425.277667:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1788652425.277842:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1788652425.277925:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1788652425.278205:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1788652425.278225:0:15703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788652425.278479:0:15703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627805440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652425.278550:0:15703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652425.278606:0:15703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b6890c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652425.280163:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627805440 00000100:00100000:1.0:1788652425.280177:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627805440 00000100:00100000:1.0:1788652425.280240:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788652425.280253:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:15703:x1875537627805440:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652425.280981:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:15703:x1875537627805440:12345-0@lo:501:mount.lustre.0 Request processed in 731us (2431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652425.280991:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788652425.282157:0:15703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627805440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652425.282217:0:15703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627805568:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788652425.282273:0:15703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652425.282312:0:15703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b6890c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652425.282366:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627805568 00000100:00100000:3.0:1788652425.282373:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627805568 00000100:00100000:3.0:1788652425.282424:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788652425.282435:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:15703:x1875537627805568:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788652425.282612:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:15703:x1875537627805568:12345-0@lo:503:mount.lustre.0 Request processed in 178us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652425.282620:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788652425.282848:0:15703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627805568:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788652425.287232:0:15703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788652425.287333:0:15703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a287100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627805696:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788652425.287415:0:15703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652425.287503:0:15703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5138c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788652425.288763:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627805696 00000100:00100000:0.0:1788652425.288789:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627805696 00000100:00100000:0.0:1788652425.288850:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788652425.288860:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:15703:x1875537627805696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788652425.289418:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:15703:x1875537627805696:12345-0@lo:502:mount.lustre.0 Request processed in 557us (2000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652425.289427:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788652425.289871:0:15703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a287100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627805696:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788652425.290174:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788652425.290235:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788652425.290272:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788652425.290356:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788652425.290399:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788652425.290459:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788652425.290513:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788652425.290548:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788652425.290593:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788652425.290631:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788652425.290675:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788652425.290742:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788652425.290809:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788652425.290852:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788652425.290906:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788652425.290941:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788652425.290978:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788652425.291025:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788652425.291059:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788652425.291097:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788652425.291151:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788652425.291188:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788652425.291222:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788652425.291278:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788652425.291322:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788652425.291363:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788652425.291448:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788652425.291492:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788652425.291527:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788652425.291586:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788652425.291624:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788652425.291672:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788652425.291719:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788652425.291792:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788652425.291829:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788652425.291875:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788652425.291913:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788652425.291946:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788652425.292000:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788652425.292057:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788652425.292110:0:15703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a287100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627805824:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788652425.292185:0:15703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652425.292239:0:15703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5138c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788652425.292316:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627805824 00000100:00100000:0.0:1788652425.292324:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627805824 00000100:00100000:0.0:1788652425.292380:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788652425.292389:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:15703:x1875537627805824:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788652425.292615:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:15703:x1875537627805824:12345-0@lo:502:mount.lustre.0 Request processed in 222us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652425.292623:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788652425.293846:0:15703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a287100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627805824:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788652425.296579:0:15703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788652425.296604:0:15703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788652425.301662:0:15713:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788652425.301681:0:15713:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8cbd43344d40) 00000020:00000080:2.0:1788652425.301711:0:15713:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788652425.301832:0:15713:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cbe81a27800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788652425.301836:0:15713:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cbe81a27800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788652425.301839:0:15713:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cbe81a27800 3 00010000:00080000:2.0:1788652425.301869:0:15713:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cbe48792800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.150@tcp at head 00010000:00010000:2.0:1788652425.306067:0:15713:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788652425.306393:0:15713:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788652425.306430:0:15713:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788652425.306444:0:15713:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x340ed74ef02a874f 00000100:00080000:2.0:1788652425.306453:0:15713:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788652425.306467:0:15713:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cbe48792800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:2.0:1788652425.306503:0:15713:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe7f90c000 x1875537627805952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788652425.306542:0:15713:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788652425.306728:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652425.306734:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788652425.306737:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652425.306740:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1788652425.306821:0:15713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:1.0:1788652425.306827:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627806080:0@lo:400:kworker.0 00000100:00100000:0.0:1788652425.306851:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875537627805952:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788652425.306899:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652425.306902:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875537627806208:0@lo:400:kworker.0 00000100:00100000:0.0:1788652425.306939:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652425.306972:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627806080 00000100:00100000:1.0:1788652425.306980:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627806080 00000100:00100000:0.0:1788652425.306996:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627806208 00000100:00100000:0.0:1788652425.307002:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627806208 00000100:00100000:1.0:1788652425.307031:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788652425.307041:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788652425.307044:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627806080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652425.307051:0:14306:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788652425.307054:0:14304:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788652425.307059:0:14306:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788652425.307063:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788652425.307071:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875537627806208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652425.307079:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652425.308845:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875537627806208:12345-0@lo:400:kworker.0 Request processed in 1767us (1898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652425.308856:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788652425.308882:0:14304:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788652425.308890:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627805952 00000100:00100000:2.0:1788652425.308896:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627805952 00000100:00100000:2.0:1788652425.308912:0:14304:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788652425.308918:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788652425.308923:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1875537627805952:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788652425.308946:0:14304:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:2.0:1788652425.308981:0:14304:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x340ed74ef02a8756 00000004:00100000:2.0:1788652425.308997:0:14304:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788652425.309029:0:14304:0:(import.c:65:import_set_state_nolock()) ffff8cbe818bb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788652425.309094:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875537627805952:12345-0@lo:38:llog_process_th.0 Request processed in 169us (2013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652425.309101:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788652425.309278:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe7f90c000 x1875537627805952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788652435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652425.309290:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788652425.309298:0:3302:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788652425.309305:0:3302:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788652425.309309:0:3302:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788652425.309311:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cbe48792800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788652425.309317:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875537627805952:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788652425.309471:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe7a286a00 x1875537627806208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652425.309492:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875537627806208:0@lo:400:kworker.0 00000100:00100000:1.0:1788652425.309797:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627806080:12345-0@lo:400:kworker.0 Request processed in 2754us (2897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652425.309808:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:01000000:2.0:1788652425.309835:0:15703:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 00010000:00080000:1.0:1788652425.309851:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cbe7a287100 x1875537627806080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652425.309864:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627806080:0@lo:400:kworker.0 10000000:01000000:2.0:1788652425.309868:0:15703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788652425.309885:0:15703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f400/0x340ed74ef02a873a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8741 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652425.309896:0:15703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f400/0x340ed74ef02a873a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a8741 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788652425.309948:0:15703:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788652425.309950:0:15703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788652425.309951:0:15703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788652425.309953:0:15703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788652425.309954:0:15703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788652425.309955:0:15703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788652425.309956:0:15703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788652425.309958:0:15703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788652425.309959:0:15703:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788652425.309963:0:15703:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788652425.309965:0:15703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788652425.309967:0:15703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788652425.309968:0:15703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788652425.309969:0:15703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788652425.309970:0:15703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788652425.309971:0:15703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788652425.309972:0:15703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788652425.309973:0:15703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788652425.309974:0:15703:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788652425.309995:0:15703:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788652425.310012:0:15703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627806336:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788652425.310074:0:15703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652425.310111:0:15703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b689e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788652425.310521:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627806336 00000100:00100000:1.0:1788652425.310534:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627806336 00000100:00100000:1.0:1788652425.310574:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788652425.310583:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:15703:x1875537627806336:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788652425.310606:0:14298:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788652425.310620:0:14298:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788652425.378756:0:14298:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788652425.379896:0:14298:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788652425.380022:0:14320:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788652425.380042:0:14320:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788652425.380070:0:14320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a875d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652425.380091:0:14320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe7a0c9200/0x340ed74ef02a86fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a86f4 expref: 19 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652425.380100:0:14320:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a875d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652425.380151:0:14320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe7a0c9200/0x340ed74ef02a86fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a86f4 expref: 19 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652425.380166:0:14320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe7a0c9200/0x340ed74ef02a86fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a86f4 expref: 19 pid: 14298 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652425.380181:0:14320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14320:1875537627806464:0@lo:104: 00000100:00100000:2.0:1788652425.380244:0:14320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652425.380327:0:14320:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4f1d99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652425.380359:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627806464 00000100:00100000:0.0:1788652425.380366:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627806464 00000100:00100000:0.0:1788652425.380422:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788652425.380432:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a384a7b-92b2-4f9e-a496-63aebbb65331+3:14320:x1875537627806464:12345-0@lo:104: 00010000:00010000:0.0:1788652425.380446:0:14287:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a86f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a86fb expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652425.380591:0:14287:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788652425.380598:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a384a7b-92b2-4f9e-a496-63aebbb65331+3:14320:x1875537627806464:12345-0@lo:104: Request processed in 167us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652425.380605:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788652425.380669:0:14320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14320:1875537627806464:0@lo:104: 00010000:00010000:2.0:1788652425.380689:0:14320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a875d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652425.380718:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652425.380724:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a86f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a86fb expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652425.380731:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215f200 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:2.0:1788652425.380735:0:14292:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a86f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a86fb expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652425.380754:0:14292:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a86f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a86fb expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652425.380762:0:14292:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a86f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a86fb expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652425.380768:0:14292:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788652425.380854:0:14292:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a86f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a86fb expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652425.380861:0:14292:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788652425.380910:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a384a7b-92b2-4f9e-a496-63aebbb65331:3305:1875537627806592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788652425.380941:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788652425.380987:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a86f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a86fb expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652425.380995:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe8215f200/0x340ed74ef02a86f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a86fb expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652425.381011:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652425.381013:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652425.381015:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652425.381061:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627806592 00000100:00100000:0.0:1788652425.381066:0:14291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627806592 00010000:00010000:0.0:1788652425.381085:0:14291:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe7a0c9200/0x340ed74ef02a86fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a86f4 expref: 20 pid: 14298 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652425.381149:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788652425.381156:0:14291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a384a7b-92b2-4f9e-a496-63aebbb65331+20:3305:x1875537627806592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788652425.381168:0:14291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652425.381174:0:14291:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe7a0c9200/0x340ed74ef02a86fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a86f4 expref: 20 pid: 14298 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652425.381184:0:14291:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe7a0c9200/0x340ed74ef02a86fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a86f4 expref: 20 pid: 14298 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652425.381197:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe7a0c9200/0x340ed74ef02a86fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a86f4 expref: 20 pid: 14298 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652425.381217:0:14291:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a875d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652425.381225:0:14291:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a875d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788652425.381239:0:14291:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001639346s 00010000:00010000:0.0:1788652425.381244:0:14291:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a875d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652425.381251:0:14291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a875d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652425.381264:0:14291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a875d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652425.381271:0:14291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a875d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652425.381276:0:14291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215ea00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:0.0:1788652425.381281:0:14291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a875d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652425.381289:0:14291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a875d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652425.381307:0:14291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a875d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652425.381316:0:14291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652425.381362:0:14291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:3305:x1875537627806592:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652425.381369:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788652425.381447:0:14320:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a875d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652425.381455:0:14320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a875d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652425.381461:0:14320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe8215ea00/0x340ed74ef02a875d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652425.381682:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a384a7b-92b2-4f9e-a496-63aebbb65331:3305:1875537627806592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788652425.390601:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+18:15703:x1875537627806336:12345-0@lo:253:mount.lustre.0 Request processed in 80010us (80518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652425.390616:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788652425.390736:0:15703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a384a7b-92b2-4f9e-a496-63aebbb65331:15703:1875537627806336:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788652425.390767:0:15703:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788652425.390831:0:15703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788652425.390832:0:15703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788652425.390834:0:15703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788652425.390835:0:15703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788652425.390836:0:15703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788652425.390837:0:15703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788652425.390839:0:15703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788652425.390841:0:15703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788652425.390842:0:15703:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788652425.390858:0:15703:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788652425.396904:0:15703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788652425.397069:0:15703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788652425.397239:0:15703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788652425.397452:0:15703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788652425.397822:0:15703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788652425.398366:0:15703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788652425.399276:0:15703:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788652425.452408:0:15703:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788652425.452416:0:15703:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788652425.452454:0:15703:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788652425.452514:0:15703:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.150@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788652425.452527:0:15703:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788652425.452554:0:15703:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788652425.544914:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652426.569048:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788652426.955363:0:14301:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788652426.955371:0:14301:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cbe48680800 from 8 10000000:01000000:2.0:1788652426.955376:0:14301:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788652426.955420:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ea00/0x340ed74ef02a8764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652426.955432:0:14301:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ea00/0x340ed74ef02a8764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652426.955443:0:14301:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ea00/0x340ed74ef02a8764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652426.955469:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627806720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788652426.955536:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652426.955601:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b286f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788652426.955735:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627806720 00000100:00100000:0.0:1788652426.955743:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627806720 00000100:00100000:0.0:1788652426.955820:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788652426.955831:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+18:14301:x1875537627806720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652426.955843:0:14299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652426.955866:0:14299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7fd11e00/0x340ed74ef02a876b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a8764 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652426.955898:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7fd11e00/0x340ed74ef02a876b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a8764 expref: 19 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652426.955909:0:14299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7fd11e00/0x340ed74ef02a876b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a8764 expref: 19 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652426.955917:0:14299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7fd11e00, rc 0) 00000100:00100000:0.0:1788652426.955958:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:14301:x1875537627806720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652426.955964:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788652426.956796:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627806720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788652426.956820:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ea00/0x340ed74ef02a8764 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a876b expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652426.956830:0:14301:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ea00/0x340ed74ef02a8764 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a876b expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652426.956891:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627806848:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788652426.956930:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652426.956984:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b286f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788652426.957007:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627806848 00000100:00100000:0.0:1788652426.957013:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627806848 00000100:00100000:0.0:1788652426.957054:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788652426.957062:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:14301:x1875537627806848:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788652426.957085:0:14298:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788652426.957102:0:14298:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788652426.957105:0:14298:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788652426.959181:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:14301:x1875537627806848:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 2111us (2241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652426.959196:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788652426.959284:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627806848:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788652426.959576:0:14301:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788652426.959588:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ea00/0x340ed74ef02a8764 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a876b expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652426.959598:0:14301:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ea00/0x340ed74ef02a8764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a876b expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652427.337870:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652412/real 1788652412] req@ffff8cbe7f2fa300 x1875537627799552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652427 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652427.337903:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbe7f2fa300 x1875537627799552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652427 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652427.337913:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652412/real 1788652412] req@ffff8cbe7f2f9880 x1875537627799680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652427 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652427.337924:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cbe7f2f9880 x1875537627799680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652427 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788652427.337942:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cbe437f1800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788652427.337960:0:3302:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788652427.337964:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875537627799552:0@lo:8:kworker.0 00000100:00080000:0.0:1788652427.337970:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cbe42d8c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788652427.337975:0:3302:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788652427.337978:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875537627799680:0@lo:8:kworker.0 00000100:00080000:3.0:1788652427.338346:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652427.338350:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788652427.338353:0:38:0:(import.c:65:import_set_state_nolock()) ffff8cbe437f1800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788652427.338358:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 429 00000100:00080000:3.0:1788652427.338363:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788652427.338368:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cbe437f1800 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1788652427.338386:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe7f2fad80 x1875537627807104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788652427.338746:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788652427.338762:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a384a7b-92b2-4f9e-a496-63aebbb65331:3305:1875537627806976:0@lo:400:kworker.0 00000100:00100000:1.0:1788652427.338843:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652427.338912:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627806976 00000100:00100000:1.0:1788652427.338920:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627806976 00000100:00100000:0.0:1788652427.338985:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788652427.338997:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:3305:x1875537627806976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652427.339058:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:3305:x1875537627806976:12345-0@lo:400:kworker.0 Request processed in 63us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652427.339075:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1788652427.339165:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652427.339169:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788652427.339172:0:38:0:(import.c:65:import_set_state_nolock()) ffff8cbe42d8c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788652427.339177:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 429 00000100:00080000:3.0:1788652427.339180:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788652427.339184:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cbe42d8c000 using connection 192.168.203.150@tcp/0@lo 00000100:00100000:3.0:1788652427.339201:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cbe7f2f8e00 x1875537627807232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788652427.339390:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a384a7b-92b2-4f9e-a496-63aebbb65331:3305:1875537627806976:0@lo:400:kworker.0 00000100:00100000:1.0:1788652427.339633:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788652427.342901:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788652427.342924:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875537627807616:0@lo:400:kworker.0 00000100:00100000:0.0:1788652427.342938:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788652427.342948:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627807488:0@lo:400:kworker.0 00000100:00100000:0.0:1788652427.343002:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652427.343048:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627807488 00000100:00100000:0.0:1788652427.343055:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627807488 00000100:00100000:0.0:1788652427.343113:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788652427.343122:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627807488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652427.343174:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627807488:12345-0@lo:400:kworker.0 Request processed in 53us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652427.343182:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788652427.343213:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652427.343931:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652427.344105:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627807616 00000100:00100000:2.0:1788652427.344112:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627807616 00000100:00100000:3.0:1788652427.344213:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875537627807104:0@lo:8:kworker.0 00000100:00100000:3.0:1788652427.344247:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652427.346172:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788652427.346185:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875537627807616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652427.346266:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875537627807616:12345-0@lo:400:kworker.0 Request processed in 84us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652427.346272:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788652427.348391:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627807360:0@lo:400:kworker.0 00000100:00100000:1.0:1788652427.348466:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652427.349020:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627807360 00000100:00100000:2.0:1788652427.349038:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627807360 00000100:00100000:2.0:1788652427.349088:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788652427.349097:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627807360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652427.349157:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627807360:12345-0@lo:400:kworker.0 Request processed in 61us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652427.349165:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788652427.349789:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875537627807232:0@lo:8:kworker.0 00000100:00100000:3.0:1788652427.349834:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788652427.349896:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7f2f8700 x1875537627807616/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652427.349911:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875537627807616:0@lo:400:kworker.0 00010000:00080000:1.0:1788652427.349937:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7f2fbb80 x1875537627807360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652427.349950:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627807360:0@lo:400:kworker.0 00000100:00080000:1.0:1788652427.351871:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788652427.353893:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7f2fa680 x1875537627807488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652427.353913:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627807488:0@lo:400:kworker.0 00000100:00100000:0.0:1788652427.353974:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627807104 00000100:00100000:0.0:1788652427.353981:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627807104 00000100:00100000:0.0:1788652427.354011:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627807232 00000100:00100000:0.0:1788652427.354014:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627807232 00000100:00100000:0.0:1788652427.354027:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788652427.354034:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1875537627807104:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788652427.354062:0:14987:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:0.0:1788652427.354097:0:14987:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x340ed74ef02a8772 00002000:00100000:0.0:1788652427.354112:0:14987:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8cbe819e8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788652427.354116:0:14987:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788652427.354128:0:14987:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788652427.354456:0:14987:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788652427.354480:0:14987:0:(import.c:65:import_set_state_nolock()) ffff8cbe819e9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788652427.354567:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1875537627807104:12345-0@lo:8:kworker.0 Request processed in 531us (10318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652427.354575:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788652427.355752:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788652427.355761:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1875537627807232:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788652427.355766:0:14989:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788652427.355792:0:14989:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:0.0:1788652427.355812:0:14987:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:0.0:1788652427.355854:0:14987:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x340ed74ef02a8779 00002000:00100000:0.0:1788652427.355869:0:14987:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8cbe819eb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788652427.355873:0:14987:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788652427.355876:0:14987:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788652427.356158:0:14987:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788652427.356181:0:14987:0:(import.c:65:import_set_state_nolock()) ffff8cbe819ed800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788652427.356252:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1875537627807232:12345-0@lo:8:kworker.0 Request processed in 491us (6417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652427.356260:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788652427.356308:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7f2fad80 x1875537627807104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788652447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652427.356320:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788652427.356327:0:3302:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788652427.356334:0:3302:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788652427.356339:0:3302:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788652427.356341:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cbe437f1800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788652427.356361:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788652427.356366:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875537627807104:0@lo:8:kworker.0 00010000:00080000:0.0:1788652427.356387:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7f2f8e00 x1875537627807232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788652447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652427.356394:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788652427.356398:0:3302:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788652427.356403:0:3302:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788652427.356406:0:3302:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788652427.356408:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8cbe42d8c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788652427.356453:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788652427.356457:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875537627807232:0@lo:8:kworker.0 00000004:00080000:2.0:1788652427.356959:0:14327:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788652427.356981:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14327:1875537627807872:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788652427.357098:0:14327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652427.357123:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b286840 going to sleep for 11 seconds 00000004:00080000:2.0:1788652427.357144:0:14326:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788652427.357348:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627807744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788652427.357382:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652427.357435:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627807872 00000100:00100000:0.0:1788652427.357442:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627807872 00000100:00100000:0.0:1788652427.357487:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000004:00080000:2.0:1788652427.357546:0:14326:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 444340772975ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788652427.357595:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627807744 00000100:00100000:3.0:1788652427.357601:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627807744 00000100:00100000:3.0:1788652427.357641:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788652427.357649:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875537627807744:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788652427.357658:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14327:x1875537627807872:12345-0@lo:5:osp-pre-0-0.0 00002000:00000024:3.0:1788652427.357876:0:14991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652427.357925:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875537627807744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 276us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652427.357931:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788652427.358155:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7f90f480 x1875537627807744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652427.358172:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627807744:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1788652427.359123:0:14329:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1788652427.359151:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a286680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14329:1875537627808128:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788652427.359192:0:14329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652427.359212:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5138c000 going to sleep for 11 seconds 00000004:00080000:1.0:1788652427.360390:0:14328:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788652427.360659:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627808128 00000100:00100000:2.0:1788652427.360668:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627808128 00000004:00080000:1.0:1788652427.361127:0:14328:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 444344354204ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788652427.361192:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788652427.361210:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627808000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788652427.361978:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652427.362039:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627808000 00000100:00100000:1.0:1788652427.362044:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627808000 00000100:00100000:1.0:1788652427.362081:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788652427.362089:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875537627808000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788652427.362121:0:14991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788652427.362165:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875537627808000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652427.362171:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788652427.362214:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7a284a80 x1875537627808000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652427.362369:0:15835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788652427.362378:0:15835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14329:x1875537627808128:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788652427.363951:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627808000:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788652427.365350:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788652427.365356:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1788652427.365666:0:14987:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788652427.365674:0:14987:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788652427.365680:0:14987:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00080000:3.0:1788652427.380604:0:15835:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788652427.380735:0:15835:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788652427.380744:0:15835:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:0.0:1788652427.385550:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.385563:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f38fade8/0x340ed74ef02a8780 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.385580:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.385585:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.385591:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f38fade8/0x340ed74ef02a8780 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.385622:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f38fade8/0x340ed74ef02a8780 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.385634:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f38fade8/0x340ed74ef02a8780 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.385642:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f38fade8/0x340ed74ef02a8780 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.385712:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788652427.389101:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.389115:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf83429/0x340ed74ef02a8787 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.389132:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.389137:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.389143:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bf83429/0x340ed74ef02a8787 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.389157:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bf83429/0x340ed74ef02a8787 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.389178:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf83429/0x340ed74ef02a8787 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.389206:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bf83429/0x340ed74ef02a8787 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.390850:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788652427.390863:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f38fade8/0x340ed74ef02a8780 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.390874:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7fd10e00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:1.0:1788652427.390879:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f38fade8/0x340ed74ef02a8780 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.390903:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f38fade8/0x340ed74ef02a8780 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.390926:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f38fade8/0x340ed74ef02a8780 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.390934:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f38fade8/0x340ed74ef02a8780 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.390958:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652427.390962:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bf83429/0x340ed74ef02a8787 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.390968:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7fd11800 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:1.0:1788652427.390971:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf83429/0x340ed74ef02a8787 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.390977:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf83429/0x340ed74ef02a8787 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.390987:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bf83429/0x340ed74ef02a8787 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.390994:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652427.390995:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652427.391003:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652427.392027:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788652427.392037:0:14987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bf83429/0x340ed74ef02a8787 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788652427.392631:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.392638:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d2c6dcd/0x340ed74ef02a878e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.392650:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.392655:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.392661:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d2c6dcd/0x340ed74ef02a878e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.392674:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d2c6dcd/0x340ed74ef02a878e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.392684:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d2c6dcd/0x340ed74ef02a878e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.392703:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d2c6dcd/0x340ed74ef02a878e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788652427.394896:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788652427.394909:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce3fbe87/0x340ed74ef02a8795 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.394924:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788652427.394936:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652427.394943:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce3fbe87/0x340ed74ef02a8795 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.394960:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce3fbe87/0x340ed74ef02a8795 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.394970:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce3fbe87/0x340ed74ef02a8795 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.394976:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce3fbe87/0x340ed74ef02a8795 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.395841:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788652427.395852:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d2c6dcd/0x340ed74ef02a878e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.395863:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7fd10600 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:1.0:1788652427.395867:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d2c6dcd/0x340ed74ef02a878e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.395878:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d2c6dcd/0x340ed74ef02a878e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.395897:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d2c6dcd/0x340ed74ef02a878e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.396128:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652427.396134:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce3fbe87/0x340ed74ef02a8795 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.396141:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5e00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:1.0:1788652427.396145:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce3fbe87/0x340ed74ef02a8795 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.396152:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce3fbe87/0x340ed74ef02a8795 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.396241:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce3fbe87/0x340ed74ef02a8795 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.396257:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652427.396259:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652427.396262:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652427.397322:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788652427.397333:0:14987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d2c6dcd/0x340ed74ef02a878e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788652427.399531:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.399542:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3c9d760/0x340ed74ef02a879c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.399558:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.399563:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.399569:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3c9d760/0x340ed74ef02a879c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.399582:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3c9d760/0x340ed74ef02a879c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.399592:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3c9d760/0x340ed74ef02a879c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.399600:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3c9d760/0x340ed74ef02a879c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.399627:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788652427.400130:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652427.400138:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3c9d760/0x340ed74ef02a879c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.400147:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7fd11400 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:1.0:1788652427.400152:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3c9d760/0x340ed74ef02a879c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.401002:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3c9d760/0x340ed74ef02a879c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.401032:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3c9d760/0x340ed74ef02a879c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.401040:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3c9d760/0x340ed74ef02a879c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.401065:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652427.401067:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652427.401069:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652427.401567:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.401575:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009818a440/0x340ed74ef02a87a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.401597:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.401601:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.401607:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009818a440/0x340ed74ef02a87a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.401619:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009818a440/0x340ed74ef02a87a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.401628:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009818a440/0x340ed74ef02a87a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.401636:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009818a440/0x340ed74ef02a87a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.401661:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788652427.402340:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652427.402347:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009818a440/0x340ed74ef02a87a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.402368:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7fd10a00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:1.0:1788652427.402372:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009818a440/0x340ed74ef02a87a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.402381:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009818a440/0x340ed74ef02a87a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.402397:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009818a440/0x340ed74ef02a87a3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.402405:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009818a440/0x340ed74ef02a87a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.402423:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652427.402424:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652427.402426:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652427.402507:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.402513:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040cd2b02/0x340ed74ef02a87aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.402523:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.402526:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.402530:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040cd2b02/0x340ed74ef02a87aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.402636:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040cd2b02/0x340ed74ef02a87aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.402655:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040cd2b02/0x340ed74ef02a87aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.402662:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040cd2b02/0x340ed74ef02a87aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.402719:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788652427.403139:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.403146:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf005f4/0x340ed74ef02a87b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.403155:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.403159:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.403230:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edf005f4/0x340ed74ef02a87b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.403253:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edf005f4/0x340ed74ef02a87b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.403262:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf005f4/0x340ed74ef02a87b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.403270:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edf005f4/0x340ed74ef02a87b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.403291:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788652427.404606:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788652427.404618:0:15835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce3fbe87/0x340ed74ef02a8795 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788652427.405398:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788652427.405407:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e98448c/0x340ed74ef02a87b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.405420:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788652427.406648:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652427.406673:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e98448c/0x340ed74ef02a87b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.406699:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e98448c/0x340ed74ef02a87b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.406723:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e98448c/0x340ed74ef02a87b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.406732:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e98448c/0x340ed74ef02a87b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.406745:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788652427.407248:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788652427.407255:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037c55149/0x340ed74ef02a87bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.407267:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788652427.407270:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652427.407274:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037c55149/0x340ed74ef02a87bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.407284:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037c55149/0x340ed74ef02a87bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.407291:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037c55149/0x340ed74ef02a87bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.407300:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037c55149/0x340ed74ef02a87bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.407318:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788652427.407755:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788652427.407761:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078ca5036/0x340ed74ef02a87c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.407807:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788652427.407811:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652427.407816:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078ca5036/0x340ed74ef02a87c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.407825:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078ca5036/0x340ed74ef02a87c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.407834:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078ca5036/0x340ed74ef02a87c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.407841:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078ca5036/0x340ed74ef02a87c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.407854:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788652427.408236:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788652427.408242:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e54b5691/0x340ed74ef02a87cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.408249:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788652427.408258:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652427.408262:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e54b5691/0x340ed74ef02a87cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.408270:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e54b5691/0x340ed74ef02a87cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.408278:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e54b5691/0x340ed74ef02a87cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.408284:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e54b5691/0x340ed74ef02a87cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.408292:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788652427.408667:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788652427.408672:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c7cf882/0x340ed74ef02a87d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.408680:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788652427.408683:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.410733:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788652427.410745:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040cd2b02/0x340ed74ef02a87aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.410757:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7fd10400 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:0.0:1788652427.410762:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040cd2b02/0x340ed74ef02a87aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.410809:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040cd2b02/0x340ed74ef02a87aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.410833:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040cd2b02/0x340ed74ef02a87aa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.410841:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040cd2b02/0x340ed74ef02a87aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.410865:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788652427.410869:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edf005f4/0x340ed74ef02a87b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.410876:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7fd10000 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:0.0:1788652427.410879:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf005f4/0x340ed74ef02a87b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.410902:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf005f4/0x340ed74ef02a87b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.410914:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edf005f4/0x340ed74ef02a87b1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.410921:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edf005f4/0x340ed74ef02a87b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.410936:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788652427.410941:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e98448c/0x340ed74ef02a87b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.410947:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4800 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:0.0:1788652427.410950:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e98448c/0x340ed74ef02a87b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.410958:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e98448c/0x340ed74ef02a87b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.410970:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e98448c/0x340ed74ef02a87b8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.410977:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e98448c/0x340ed74ef02a87b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411005:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788652427.411008:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037c55149/0x340ed74ef02a87bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411014:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5800 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:0.0:1788652427.411017:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037c55149/0x340ed74ef02a87bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411025:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037c55149/0x340ed74ef02a87bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411035:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037c55149/0x340ed74ef02a87bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411040:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037c55149/0x340ed74ef02a87bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411051:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788652427.411055:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078ca5036/0x340ed74ef02a87c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411061:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4000 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:0.0:1788652427.411064:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078ca5036/0x340ed74ef02a87c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411083:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078ca5036/0x340ed74ef02a87c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411093:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078ca5036/0x340ed74ef02a87c6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411099:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078ca5036/0x340ed74ef02a87c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411114:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652427.411118:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e54b5691/0x340ed74ef02a87cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411124:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4600 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:0.0:1788652427.411127:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e54b5691/0x340ed74ef02a87cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411134:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e54b5691/0x340ed74ef02a87cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411143:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e54b5691/0x340ed74ef02a87cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411151:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e54b5691/0x340ed74ef02a87cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411175:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652427.411177:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652427.411179:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652427.411684:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.411702:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dab9ed5a/0x340ed74ef02a87db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411714:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.411719:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.411725:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dab9ed5a/0x340ed74ef02a87db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411738:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dab9ed5a/0x340ed74ef02a87db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411746:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dab9ed5a/0x340ed74ef02a87db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411753:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dab9ed5a/0x340ed74ef02a87db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411792:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652427.411804:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652427.411808:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dab9ed5a/0x340ed74ef02a87db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411827:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7fd11a00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:0.0:1788652427.411830:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dab9ed5a/0x340ed74ef02a87db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411838:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dab9ed5a/0x340ed74ef02a87db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411850:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dab9ed5a/0x340ed74ef02a87db lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411856:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dab9ed5a/0x340ed74ef02a87db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.411869:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652427.411871:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652427.411872:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652427.412377:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.412384:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd8412b2/0x340ed74ef02a87e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.412394:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.412398:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.412402:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd8412b2/0x340ed74ef02a87e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.412412:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd8412b2/0x340ed74ef02a87e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.412426:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd8412b2/0x340ed74ef02a87e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.412434:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd8412b2/0x340ed74ef02a87e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.412454:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.412479:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.412487:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd8412b2/0x340ed74ef02a87e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788652427.412895:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.412902:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025b20783/0x340ed74ef02a87e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.412910:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.412913:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.412917:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025b20783/0x340ed74ef02a87e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.412926:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025b20783/0x340ed74ef02a87e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.412934:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025b20783/0x340ed74ef02a87e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.412941:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025b20783/0x340ed74ef02a87e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.412963:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.413130:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7bc87800 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.413137:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd8412b2/0x340ed74ef02a87e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.413148:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd8412b2/0x340ed74ef02a87e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.413168:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd8412b2/0x340ed74ef02a87e2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.413181:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd8412b2/0x340ed74ef02a87e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.413199:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.413203:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025b20783/0x340ed74ef02a87e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.413210:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7bc86800 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.413213:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025b20783/0x340ed74ef02a87e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.413222:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025b20783/0x340ed74ef02a87e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.413234:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025b20783/0x340ed74ef02a87e9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.413240:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025b20783/0x340ed74ef02a87e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.413254:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.413256:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.413258:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652427.413352:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.413358:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c1b8af6/0x340ed74ef02a87f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.413366:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.413370:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.413374:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c1b8af6/0x340ed74ef02a87f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.413382:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c1b8af6/0x340ed74ef02a87f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.413390:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c1b8af6/0x340ed74ef02a87f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.413397:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c1b8af6/0x340ed74ef02a87f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.413419:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.413459:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.413465:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c1b8af6/0x340ed74ef02a87f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.413478:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7bc87600 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.413482:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c1b8af6/0x340ed74ef02a87f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.413490:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c1b8af6/0x340ed74ef02a87f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.413533:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c7cf882/0x340ed74ef02a87d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.413552:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c7cf882/0x340ed74ef02a87d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.413561:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c7cf882/0x340ed74ef02a87d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.413575:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c7cf882/0x340ed74ef02a87d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.413717:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c1b8af6/0x340ed74ef02a87f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.413726:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c1b8af6/0x340ed74ef02a87f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.413739:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.413741:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.413743:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.413813:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.413823:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.413827:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c7cf882/0x340ed74ef02a87d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.413835:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4a00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.413839:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c7cf882/0x340ed74ef02a87d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.413858:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c7cf882/0x340ed74ef02a87d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.413870:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c7cf882/0x340ed74ef02a87d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.413877:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c7cf882/0x340ed74ef02a87d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.413894:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.413896:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.413898:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652427.414473:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652427.414493:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788652427.415113:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000674db3dc/0x340ed74ef02a87f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.415127:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788652427.415132:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652427.415137:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000674db3dc/0x340ed74ef02a87f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.415149:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000674db3dc/0x340ed74ef02a87f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.415159:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000674db3dc/0x340ed74ef02a87f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.415176:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000674db3dc/0x340ed74ef02a87f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.415210:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.415220:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.415225:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000674db3dc/0x340ed74ef02a87f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.415233:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215f000 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.415237:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000674db3dc/0x340ed74ef02a87f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.415246:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000674db3dc/0x340ed74ef02a87f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.415261:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000674db3dc/0x340ed74ef02a87f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.415269:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000674db3dc/0x340ed74ef02a87f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.415284:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.415286:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.415288:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652427.415944:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788652427.415959:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a58c37e8/0x340ed74ef02a87fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.415969:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788652427.415973:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652427.416111:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a58c37e8/0x340ed74ef02a87fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.416124:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a58c37e8/0x340ed74ef02a87fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.416133:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a58c37e8/0x340ed74ef02a87fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.416140:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a58c37e8/0x340ed74ef02a87fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.416159:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788652427.416728:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788652427.416735:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f17936d/0x340ed74ef02a8805 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.416744:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788652427.416748:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652427.416752:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f17936d/0x340ed74ef02a8805 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.416761:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f17936d/0x340ed74ef02a8805 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.416798:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f17936d/0x340ed74ef02a8805 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.416805:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f17936d/0x340ed74ef02a8805 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.416821:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788652427.416831:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788652427.416837:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a58c37e8/0x340ed74ef02a87fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.416843:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e000 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.416847:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a58c37e8/0x340ed74ef02a87fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.416856:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a58c37e8/0x340ed74ef02a87fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.416870:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a58c37e8/0x340ed74ef02a87fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.416876:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a58c37e8/0x340ed74ef02a87fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.416890:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.416899:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f17936d/0x340ed74ef02a8805 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.416904:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe40031000 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.416907:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f17936d/0x340ed74ef02a8805 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.416915:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f17936d/0x340ed74ef02a8805 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.416924:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f17936d/0x340ed74ef02a8805 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.416931:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f17936d/0x340ed74ef02a8805 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.416942:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.416944:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.416945:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652427.417499:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652427.418151:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788652427.418160:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dfcac16/0x340ed74ef02a880c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.418172:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788652427.418175:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652427.418181:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001dfcac16/0x340ed74ef02a880c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.418203:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001dfcac16/0x340ed74ef02a880c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.418212:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dfcac16/0x340ed74ef02a880c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.418219:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001dfcac16/0x340ed74ef02a880c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.418233:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.418244:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.418248:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001dfcac16/0x340ed74ef02a880c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.418253:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe40030a00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.418257:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001dfcac16/0x340ed74ef02a880c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.418266:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001dfcac16/0x340ed74ef02a880c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.418279:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001dfcac16/0x340ed74ef02a880c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.418286:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001dfcac16/0x340ed74ef02a880c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.418309:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.418312:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.418314:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652427.419240:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788652427.419249:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000293f042e/0x340ed74ef02a8813 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.419261:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788652427.419264:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652427.419269:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000293f042e/0x340ed74ef02a8813 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.419281:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000293f042e/0x340ed74ef02a8813 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.419288:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000293f042e/0x340ed74ef02a8813 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.419294:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000293f042e/0x340ed74ef02a8813 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.419312:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.419323:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.419327:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000293f042e/0x340ed74ef02a8813 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.419347:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe40031c00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.419351:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000293f042e/0x340ed74ef02a8813 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.419359:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000293f042e/0x340ed74ef02a8813 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.419373:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000293f042e/0x340ed74ef02a8813 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.419391:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000293f042e/0x340ed74ef02a8813 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.419407:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.419409:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.419411:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652427.421415:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788652427.421428:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049a7808c/0x340ed74ef02a881a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.421444:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788652427.421448:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652427.421454:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049a7808c/0x340ed74ef02a881a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.421467:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049a7808c/0x340ed74ef02a881a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.421484:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049a7808c/0x340ed74ef02a881a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.421493:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049a7808c/0x340ed74ef02a881a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.421511:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.421522:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.421528:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049a7808c/0x340ed74ef02a881a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.421535:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe40030e00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.421539:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049a7808c/0x340ed74ef02a881a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.421547:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049a7808c/0x340ed74ef02a881a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.421565:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049a7808c/0x340ed74ef02a881a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.421573:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049a7808c/0x340ed74ef02a881a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.421598:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.421606:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.421608:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652427.422032:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.422040:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdede6f3/0x340ed74ef02a8821 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.422051:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.422061:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.422067:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdede6f3/0x340ed74ef02a8821 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.422079:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdede6f3/0x340ed74ef02a8821 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.422088:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdede6f3/0x340ed74ef02a8821 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.422095:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdede6f3/0x340ed74ef02a8821 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.422117:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.422746:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.422754:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdede6f3/0x340ed74ef02a8821 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.422763:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7bc86600 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.422768:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdede6f3/0x340ed74ef02a8821 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.422793:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdede6f3/0x340ed74ef02a8821 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.422810:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdede6f3/0x340ed74ef02a8821 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.422821:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdede6f3/0x340ed74ef02a8821 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.422840:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.422842:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.422844:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652427.423290:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788652427.423297:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bf89416/0x340ed74ef02a8828 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.423308:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788652427.423311:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652427.423322:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bf89416/0x340ed74ef02a8828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.423331:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bf89416/0x340ed74ef02a8828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.423339:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bf89416/0x340ed74ef02a8828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.423345:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bf89416/0x340ed74ef02a8828 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.423361:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.423370:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.423373:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bf89416/0x340ed74ef02a8828 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.423391:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe40031e00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.423395:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bf89416/0x340ed74ef02a8828 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.423403:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bf89416/0x340ed74ef02a8828 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.423413:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bf89416/0x340ed74ef02a8828 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.423431:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bf89416/0x340ed74ef02a8828 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.423447:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.423449:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.423450:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652427.424127:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.424136:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016927235/0x340ed74ef02a882f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.424148:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.424152:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.424157:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016927235/0x340ed74ef02a882f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.424188:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016927235/0x340ed74ef02a882f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.424196:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016927235/0x340ed74ef02a882f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.424209:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016927235/0x340ed74ef02a882f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.424235:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788652427.424671:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.424677:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc64ffb6/0x340ed74ef02a8836 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.424697:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.424701:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.424706:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc64ffb6/0x340ed74ef02a8836 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.424716:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc64ffb6/0x340ed74ef02a8836 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.424723:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc64ffb6/0x340ed74ef02a8836 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.424729:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc64ffb6/0x340ed74ef02a8836 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.424743:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788652427.424883:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788652427.424890:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016927235/0x340ed74ef02a882f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.424899:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7bc86c00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.424904:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016927235/0x340ed74ef02a882f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.424914:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016927235/0x340ed74ef02a882f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.424932:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016927235/0x340ed74ef02a882f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.424940:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016927235/0x340ed74ef02a882f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.424957:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.424961:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc64ffb6/0x340ed74ef02a8836 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.424974:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7bc86200 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.424977:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc64ffb6/0x340ed74ef02a8836 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.424986:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc64ffb6/0x340ed74ef02a8836 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.424997:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc64ffb6/0x340ed74ef02a8836 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.425005:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc64ffb6/0x340ed74ef02a8836 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.425019:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.425021:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.425023:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.425030:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652427.425089:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788652427.425095:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a883d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.425105:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788652427.425109:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652427.425113:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a883d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.425136:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a883d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.425146:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a883d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.425153:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a883d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.425167:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.425176:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.425179:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a883d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.425187:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe40031a00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.425191:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a883d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.425199:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a883d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.425210:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a883d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.425218:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000102b4901/0x340ed74ef02a883d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.425240:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.425242:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.425244:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652427.425822:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.425829:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000360cb12f/0x340ed74ef02a8844 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788652427.426013:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788652427.426019:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000259f6ee7/0x340ed74ef02a884b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.426031:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788652427.426035:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652427.426040:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000259f6ee7/0x340ed74ef02a884b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.426051:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000259f6ee7/0x340ed74ef02a884b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.426142:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000259f6ee7/0x340ed74ef02a884b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.426150:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000259f6ee7/0x340ed74ef02a884b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.426167:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.426178:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.426183:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000259f6ee7/0x340ed74ef02a884b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.426202:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75dd1600 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.426206:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000259f6ee7/0x340ed74ef02a884b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.426214:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000259f6ee7/0x340ed74ef02a884b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.426229:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000259f6ee7/0x340ed74ef02a884b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.426237:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000259f6ee7/0x340ed74ef02a884b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.426254:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.426256:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.426258:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652427.426811:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.426815:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.426820:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000360cb12f/0x340ed74ef02a8844 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.426831:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000360cb12f/0x340ed74ef02a8844 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.426952:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000360cb12f/0x340ed74ef02a8844 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.426961:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000360cb12f/0x340ed74ef02a8844 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.426984:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.427072:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.427078:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000360cb12f/0x340ed74ef02a8844 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.427086:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7bc87400 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.427090:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000360cb12f/0x340ed74ef02a8844 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.427098:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000360cb12f/0x340ed74ef02a8844 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.427118:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000360cb12f/0x340ed74ef02a8844 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.427125:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000360cb12f/0x340ed74ef02a8844 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.427141:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.427143:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.427145:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652427.427530:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788652427.427537:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048fcb9e9/0x340ed74ef02a8852 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.427546:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788652427.427549:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652427.427554:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048fcb9e9/0x340ed74ef02a8852 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.427562:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048fcb9e9/0x340ed74ef02a8852 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.427570:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048fcb9e9/0x340ed74ef02a8852 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.427578:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048fcb9e9/0x340ed74ef02a8852 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.427606:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.427699:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.427705:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048fcb9e9/0x340ed74ef02a8852 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.427712:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75dd0600 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.427716:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048fcb9e9/0x340ed74ef02a8852 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.427724:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048fcb9e9/0x340ed74ef02a8852 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.427736:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048fcb9e9/0x340ed74ef02a8852 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.427743:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048fcb9e9/0x340ed74ef02a8852 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.427765:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.427767:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.427790:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652427.428212:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788652427.428218:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e82d7979/0x340ed74ef02a8859 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.428227:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788652427.428237:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652427.428243:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e82d7979/0x340ed74ef02a8859 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.428254:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e82d7979/0x340ed74ef02a8859 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.428263:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e82d7979/0x340ed74ef02a8859 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.428271:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e82d7979/0x340ed74ef02a8859 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.428287:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.428297:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.428302:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e82d7979/0x340ed74ef02a8859 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.428310:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75dd0c00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.428314:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e82d7979/0x340ed74ef02a8859 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.428323:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e82d7979/0x340ed74ef02a8859 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.428335:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e82d7979/0x340ed74ef02a8859 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.428355:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e82d7979/0x340ed74ef02a8859 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.428375:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.428377:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.428379:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652427.428417:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.428425:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aa894db/0x340ed74ef02a8860 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.428434:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.428437:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.428441:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aa894db/0x340ed74ef02a8860 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.428451:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006aa894db/0x340ed74ef02a8860 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788652427.428755:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788652427.428926:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aa894db/0x340ed74ef02a8860 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.428933:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006aa894db/0x340ed74ef02a8860 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.428951:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.429785:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.429792:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006aa894db/0x340ed74ef02a8860 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.429802:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7bc87200 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.429806:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006aa894db/0x340ed74ef02a8860 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.429816:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006aa894db/0x340ed74ef02a8860 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.429834:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006aa894db/0x340ed74ef02a8860 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.429842:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aa894db/0x340ed74ef02a8860 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.429861:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.429863:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.429864:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652427.430973:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.430984:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c2856dd/0x340ed74ef02a8867 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.430998:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.431002:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.431010:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c2856dd/0x340ed74ef02a8867 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.431023:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c2856dd/0x340ed74ef02a8867 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.431032:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c2856dd/0x340ed74ef02a8867 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.431040:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c2856dd/0x340ed74ef02a8867 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.431075:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.431188:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.431195:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c2856dd/0x340ed74ef02a8867 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.431204:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7bc86400 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.431208:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c2856dd/0x340ed74ef02a8867 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.431217:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c2856dd/0x340ed74ef02a8867 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.431233:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c2856dd/0x340ed74ef02a8867 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.431240:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c2856dd/0x340ed74ef02a8867 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.431258:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.431261:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.431263:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652427.431276:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788652427.431283:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e129faa/0x340ed74ef02a886e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.431291:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788652427.431294:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652427.431299:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e129faa/0x340ed74ef02a886e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.431322:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e129faa/0x340ed74ef02a886e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.431332:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e129faa/0x340ed74ef02a886e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.431340:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e129faa/0x340ed74ef02a886e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.431356:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.431365:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.431370:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e129faa/0x340ed74ef02a886e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.431377:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75dd0200 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.431393:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e129faa/0x340ed74ef02a886e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.431403:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e129faa/0x340ed74ef02a886e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.431415:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e129faa/0x340ed74ef02a886e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.431423:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e129faa/0x340ed74ef02a886e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.431450:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.431452:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.431454:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652427.431969:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788652427.431976:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008187c8bc/0x340ed74ef02a8875 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.431985:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788652427.431988:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652427.431993:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008187c8bc/0x340ed74ef02a8875 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.432003:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008187c8bc/0x340ed74ef02a8875 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.432012:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008187c8bc/0x340ed74ef02a8875 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.432019:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008187c8bc/0x340ed74ef02a8875 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.432033:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.432042:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.432046:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008187c8bc/0x340ed74ef02a8875 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.432064:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75dd1400 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.432068:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008187c8bc/0x340ed74ef02a8875 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.432076:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008187c8bc/0x340ed74ef02a8875 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.432088:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008187c8bc/0x340ed74ef02a8875 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.432095:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008187c8bc/0x340ed74ef02a8875 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.432110:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.432112:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.432113:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652427.432546:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788652427.432552:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a1a4a6d/0x340ed74ef02a887c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.432561:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788652427.432564:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652427.432568:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a1a4a6d/0x340ed74ef02a887c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.432578:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a1a4a6d/0x340ed74ef02a887c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.432594:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a1a4a6d/0x340ed74ef02a887c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.432600:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a1a4a6d/0x340ed74ef02a887c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.432613:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.432621:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.432626:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a1a4a6d/0x340ed74ef02a887c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.432632:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75dd1200 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.432635:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a1a4a6d/0x340ed74ef02a887c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.432642:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a1a4a6d/0x340ed74ef02a887c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.432653:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a1a4a6d/0x340ed74ef02a887c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.432660:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a1a4a6d/0x340ed74ef02a887c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.432673:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.432681:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.432683:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652427.433015:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.433022:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004339d778/0x340ed74ef02a8883 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.433032:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.433035:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.433040:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004339d778/0x340ed74ef02a8883 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.433051:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004339d778/0x340ed74ef02a8883 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.433058:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004339d778/0x340ed74ef02a8883 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.433063:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004339d778/0x340ed74ef02a8883 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.433079:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652427.433101:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652427.433107:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004339d778/0x340ed74ef02a8883 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.433115:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7bc86a00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:3.0:1788652427.433119:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004339d778/0x340ed74ef02a8883 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.433127:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004339d778/0x340ed74ef02a8883 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.433142:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004339d778/0x340ed74ef02a8883 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.433149:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004339d778/0x340ed74ef02a8883 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.433167:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652427.433169:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652427.433171:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652427.433181:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788652427.433188:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac28cd71/0x340ed74ef02a888a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.433196:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788652427.433198:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652427.433203:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac28cd71/0x340ed74ef02a888a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.433211:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac28cd71/0x340ed74ef02a888a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.433218:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac28cd71/0x340ed74ef02a888a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.433225:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac28cd71/0x340ed74ef02a888a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.433239:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.433248:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.433251:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac28cd71/0x340ed74ef02a888a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.433257:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75dd0400 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.433260:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac28cd71/0x340ed74ef02a888a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.433278:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac28cd71/0x340ed74ef02a888a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.433288:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac28cd71/0x340ed74ef02a888a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.433295:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac28cd71/0x340ed74ef02a888a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.433314:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.433317:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.433319:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652427.433858:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788652427.433864:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000592a966a/0x340ed74ef02a8891 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.433873:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788652427.433876:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652427.433880:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000592a966a/0x340ed74ef02a8891 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.433890:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000592a966a/0x340ed74ef02a8891 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.433898:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000592a966a/0x340ed74ef02a8891 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.433916:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000592a966a/0x340ed74ef02a8891 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.433933:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.433941:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.433945:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000592a966a/0x340ed74ef02a8891 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.433951:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75dd0a00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.433954:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000592a966a/0x340ed74ef02a8891 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.433962:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000592a966a/0x340ed74ef02a8891 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.433974:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000592a966a/0x340ed74ef02a8891 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.433983:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000592a966a/0x340ed74ef02a8891 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.433999:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.434001:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.434004:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652427.434166:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.434172:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088297ea6/0x340ed74ef02a8898 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.434182:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.434192:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.434197:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088297ea6/0x340ed74ef02a8898 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.434208:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088297ea6/0x340ed74ef02a8898 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.434217:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088297ea6/0x340ed74ef02a8898 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.434224:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088297ea6/0x340ed74ef02a8898 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.434248:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788652427.434517:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788652427.434531:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fdd1b4a/0x340ed74ef02a889f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.434540:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788652427.434543:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652427.434547:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fdd1b4a/0x340ed74ef02a889f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.434556:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fdd1b4a/0x340ed74ef02a889f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.434564:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fdd1b4a/0x340ed74ef02a889f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.434571:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fdd1b4a/0x340ed74ef02a889f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.434586:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788652427.434595:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788652427.434599:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088297ea6/0x340ed74ef02a8898 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.434605:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7bc86e00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.434609:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088297ea6/0x340ed74ef02a8898 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.434616:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088297ea6/0x340ed74ef02a8898 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.434635:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088297ea6/0x340ed74ef02a8898 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.434642:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088297ea6/0x340ed74ef02a8898 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.434658:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.434662:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fdd1b4a/0x340ed74ef02a889f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.434669:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75dd0e00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.434672:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fdd1b4a/0x340ed74ef02a889f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.434679:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fdd1b4a/0x340ed74ef02a889f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788652427.435079:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.435085:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c08f274d/0x340ed74ef02a88a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.435094:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.435097:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.435101:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c08f274d/0x340ed74ef02a88a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652427.435104:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652427.435111:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c08f274d/0x340ed74ef02a88a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.435119:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c08f274d/0x340ed74ef02a88a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.435134:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c08f274d/0x340ed74ef02a88a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.435154:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652427.435183:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1788652427.435920:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.435929:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dc91aa3/0x340ed74ef02a88ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.435940:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.435943:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.435947:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004dc91aa3/0x340ed74ef02a88ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.435958:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004dc91aa3/0x340ed74ef02a88ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.435967:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004dc91aa3/0x340ed74ef02a88ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.435974:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004dc91aa3/0x340ed74ef02a88ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.435984:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788652427.436546:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.436552:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081524847/0x340ed74ef02a88b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.436569:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.436572:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.436577:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081524847/0x340ed74ef02a88b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.436822:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081524847/0x340ed74ef02a88b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.436833:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081524847/0x340ed74ef02a88b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.436840:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081524847/0x340ed74ef02a88b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.436850:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788652427.437279:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.437285:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025cdcdd7/0x340ed74ef02a88bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.437294:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.437298:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.437303:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025cdcdd7/0x340ed74ef02a88bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.437312:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025cdcdd7/0x340ed74ef02a88bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.437331:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025cdcdd7/0x340ed74ef02a88bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.437338:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025cdcdd7/0x340ed74ef02a88bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.437347:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788652427.438542:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.438552:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081a86e7b/0x340ed74ef02a88c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.438565:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.438569:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.438575:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081a86e7b/0x340ed74ef02a88c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.438599:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081a86e7b/0x340ed74ef02a88c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.438610:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081a86e7b/0x340ed74ef02a88c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.438619:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081a86e7b/0x340ed74ef02a88c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.438640:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788652427.439249:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.439257:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b44934cc/0x340ed74ef02a88c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.439266:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.439270:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.439274:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b44934cc/0x340ed74ef02a88c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.439284:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b44934cc/0x340ed74ef02a88c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.439292:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b44934cc/0x340ed74ef02a88c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.439299:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b44934cc/0x340ed74ef02a88c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.439307:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1788652427.440189:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fdd1b4a/0x340ed74ef02a889f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.440204:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fdd1b4a/0x340ed74ef02a889f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.440237:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788652427.440243:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004dc91aa3/0x340ed74ef02a88ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.440257:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7bc87c00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.440262:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004dc91aa3/0x340ed74ef02a88ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.440273:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004dc91aa3/0x340ed74ef02a88ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.440289:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004dc91aa3/0x340ed74ef02a88ad lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.440297:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004dc91aa3/0x340ed74ef02a88ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.440316:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788652427.440321:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081524847/0x340ed74ef02a88b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.440327:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7bc87e00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.440331:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081524847/0x340ed74ef02a88b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.440338:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081524847/0x340ed74ef02a88b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.440349:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081524847/0x340ed74ef02a88b4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.440364:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081524847/0x340ed74ef02a88b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.441353:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788652427.441360:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025cdcdd7/0x340ed74ef02a88bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.441370:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7bc87a00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.441374:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025cdcdd7/0x340ed74ef02a88bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.441387:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025cdcdd7/0x340ed74ef02a88bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.441401:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025cdcdd7/0x340ed74ef02a88bb lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.441408:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025cdcdd7/0x340ed74ef02a88bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.441422:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788652427.441427:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081a86e7b/0x340ed74ef02a88c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.441435:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7bc86000 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.441445:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081a86e7b/0x340ed74ef02a88c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.441452:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081a86e7b/0x340ed74ef02a88c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.441464:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081a86e7b/0x340ed74ef02a88c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.441471:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081a86e7b/0x340ed74ef02a88c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.441498:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.441502:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b44934cc/0x340ed74ef02a88c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.441508:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75f1a800 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.441511:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b44934cc/0x340ed74ef02a88c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.441519:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b44934cc/0x340ed74ef02a88c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.441529:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b44934cc/0x340ed74ef02a88c9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.441537:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b44934cc/0x340ed74ef02a88c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.441559:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.441562:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.441564:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652427.442354:0:15837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652427.442364:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c08f274d/0x340ed74ef02a88a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.442375:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7bc87000 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:1.0:1788652427.442380:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c08f274d/0x340ed74ef02a88a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.442404:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c08f274d/0x340ed74ef02a88a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.442420:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c08f274d/0x340ed74ef02a88a6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.442429:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c08f274d/0x340ed74ef02a88a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652427.442448:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652427.442449:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652427.442452:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652427.442456:0:15837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652427.442458:0:15837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652427.442663:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788652427.442670:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84f88ae/0x340ed74ef02a88d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.442682:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788652427.442697:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652427.442704:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d84f88ae/0x340ed74ef02a88d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.442716:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d84f88ae/0x340ed74ef02a88d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.442725:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d84f88ae/0x340ed74ef02a88d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.442732:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d84f88ae/0x340ed74ef02a88d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.442750:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.442759:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.442763:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d84f88ae/0x340ed74ef02a88d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.442801:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75dd1000 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.442804:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84f88ae/0x340ed74ef02a88d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.442812:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d84f88ae/0x340ed74ef02a88d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.442823:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d84f88ae/0x340ed74ef02a88d0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.442828:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d84f88ae/0x340ed74ef02a88d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.442843:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.442844:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.442846:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652427.443062:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.443070:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfe95f6b/0x340ed74ef02a88d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.443080:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.443089:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.443094:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfe95f6b/0x340ed74ef02a88d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.443104:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfe95f6b/0x340ed74ef02a88d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.443113:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfe95f6b/0x340ed74ef02a88d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.443120:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfe95f6b/0x340ed74ef02a88d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.443137:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788652427.443820:0:14987:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788652427.443828:0:14987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eb92a64/0x340ed74ef02a88de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.443838:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=444s v=(0 0) 00010000:00010000:0.0:1788652427.443841:0:14987:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652427.443846:0:14987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eb92a64/0x340ed74ef02a88de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.443856:0:14987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003eb92a64/0x340ed74ef02a88de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.443865:0:14987:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eb92a64/0x340ed74ef02a88de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.443880:0:14987:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003eb92a64/0x340ed74ef02a88de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652427.443893:0:14987:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:0.0:1788652427.444101:0:14987:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:0.0:1788652427.444187:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14327:x1875537627807872:12345-0@lo:5:osp-pre-0-0.0 Request processed in 86528us (87086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652427.444196:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788652427.444713:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14327:1875537627807872:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788652427.444729:0:14327:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788652427.444840:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14327:1875537627808256:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788652427.444876:0:14327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652427.444925:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b286840 going to sleep for 11 seconds 00000100:00100000:0.0:1788652427.444946:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627808256 00000100:00100000:0.0:1788652427.444954:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627808256 00000100:00100000:0.0:1788652427.444991:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788652427.445001:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14327:x1875537627808256:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788652427.445043:0:14989:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00002000:00010000:2.0:1788652427.445437:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788652427.445444:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d3aef04/0x340ed74ef02a88e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.445467:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788652427.445471:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652427.445477:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d3aef04/0x340ed74ef02a88e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.446178:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d3aef04/0x340ed74ef02a88e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.446193:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d3aef04/0x340ed74ef02a88e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.446208:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d3aef04/0x340ed74ef02a88e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.446226:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788652427.446242:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788652427.446249:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfe95f6b/0x340ed74ef02a88d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.446258:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75f1b600 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.446263:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfe95f6b/0x340ed74ef02a88d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.446271:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfe95f6b/0x340ed74ef02a88d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.446302:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfe95f6b/0x340ed74ef02a88d7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.446310:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfe95f6b/0x340ed74ef02a88d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.446336:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788652427.446341:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003eb92a64/0x340ed74ef02a88de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.446348:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75f1a600 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.446352:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003eb92a64/0x340ed74ef02a88de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.446359:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003eb92a64/0x340ed74ef02a88de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.446370:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003eb92a64/0x340ed74ef02a88de lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.446376:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003eb92a64/0x340ed74ef02a88de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.446390:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.446394:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d3aef04/0x340ed74ef02a88e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.446407:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75dd1c00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.446411:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d3aef04/0x340ed74ef02a88e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.446419:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d3aef04/0x340ed74ef02a88e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.446502:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d3aef04/0x340ed74ef02a88e5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.446509:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d3aef04/0x340ed74ef02a88e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.446523:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.446524:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.446526:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652427.449271:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788652427.449284:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fcf9f73/0x340ed74ef02a88ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.449300:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788652427.449305:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652427.449312:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fcf9f73/0x340ed74ef02a88ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.449328:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fcf9f73/0x340ed74ef02a88ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.449346:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fcf9f73/0x340ed74ef02a88ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.449354:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fcf9f73/0x340ed74ef02a88ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.449377:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.449392:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.449398:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fcf9f73/0x340ed74ef02a88ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.449404:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75dd1e00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.449408:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fcf9f73/0x340ed74ef02a88ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.449416:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fcf9f73/0x340ed74ef02a88ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.449430:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fcf9f73/0x340ed74ef02a88ec lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.449437:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fcf9f73/0x340ed74ef02a88ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.449459:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.449467:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.449469:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652427.450548:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788652427.450557:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009577b798/0x340ed74ef02a88f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.450570:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788652427.450574:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652427.450580:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009577b798/0x340ed74ef02a88f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.450592:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009577b798/0x340ed74ef02a88f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.450602:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009577b798/0x340ed74ef02a88f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.450610:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009577b798/0x340ed74ef02a88f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.450640:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.450654:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.450659:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009577b798/0x340ed74ef02a88f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.450666:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75dd1a00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.450671:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009577b798/0x340ed74ef02a88f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.450700:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009577b798/0x340ed74ef02a88f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.450717:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009577b798/0x340ed74ef02a88f3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.450724:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009577b798/0x340ed74ef02a88f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.450745:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.450748:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.450751:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652427.451429:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788652427.451435:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f7e3d8c/0x340ed74ef02a88fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.451444:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1788652427.451447:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652427.451452:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f7e3d8c/0x340ed74ef02a88fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.451461:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f7e3d8c/0x340ed74ef02a88fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.451468:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f7e3d8c/0x340ed74ef02a88fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.451488:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f7e3d8c/0x340ed74ef02a88fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.451501:0:15835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652427.451510:0:14292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652427.451515:0:14292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f7e3d8c/0x340ed74ef02a88fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.451521:0:14292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75dd0000 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652427.451525:0:14292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f7e3d8c/0x340ed74ef02a88fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.451533:0:14292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f7e3d8c/0x340ed74ef02a88fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.451548:0:14292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f7e3d8c/0x340ed74ef02a88fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.451556:0:14292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f7e3d8c/0x340ed74ef02a88fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652427.451581:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.451583:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652427.451585:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788652427.452360:0:15835:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1788652427.452447:0:15835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14329:x1875537627808128:12345-0@lo:5:osp-pre-1-0.0 Request processed in 90067us (93250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652427.452462:0:15835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788652427.452679:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14327:x1875537627808256:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7677us (7799us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788652427.452697:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788652427.452959:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14327:1875537627808256:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788652427.452977:0:14327:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1788652427.453828:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652427.453837:0:15837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652427.454197:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a286680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14329:1875537627808128:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788652427.454212:0:14329:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1788652427.454634:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7a286680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14329:1875537627808384:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788652427.456088:0:14329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652427.456396:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe5138c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788652427.456539:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627808384 00000100:00100000:0.0:1788652427.456549:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627808384 00000100:00100000:0.0:1788652427.456604:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788652427.456614:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14329:x1875537627808384:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788652427.456660:0:14987:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1788652427.464322:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14329:x1875537627808384:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7702us (9627us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788652427.464334:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788652427.464578:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7a286680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14329:1875537627808384:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788652427.464597:0:14329:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:1.0:1788652427.495874:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1788652427.591912:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652428.629985:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788652429.635457:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788652429.635509:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788652429.639902:0:15837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788652430.601136:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1788652430.601155:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788652430.664860:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788652431.362214:0:16065:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg350-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788652431.693060:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652432.520721:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627808512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788652432.520814:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652432.520913:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627808512 00000100:00100000:3.0:1788652432.520920:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627808512 00000100:00100000:3.0:1788652432.521356:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788652432.521368:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627808512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788652432.521405:0:14991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652432.521462:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627808512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652432.521470:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788652432.521678:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788652432.521705:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627808512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788652432.521850:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627808768:0@lo:400:kworker.0 00000100:00100000:3.0:1788652432.521899:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652432.522178:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788652432.522189:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a384a7b-92b2-4f9e-a496-63aebbb65331:3306:1875537627808640:0@lo:400:kworker.0 00000100:00100000:3.0:1788652432.522228:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652432.522293:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875537627809152:0@lo:400:kworker.0 00000100:00100000:3.0:1788652432.522326:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652432.522371:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627808640 00000100:00100000:3.0:1788652432.522377:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627808640 00000100:00100000:3.0:1788652432.522421:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788652432.522431:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:3306:x1875537627808640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652432.522499:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:3306:x1875537627808640:12345-0@lo:400:kworker.0 Request processed in 69us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652432.522508:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788652432.522560:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627809152 00000100:00100000:3.0:1788652432.522564:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627809152 00000100:00100000:3.0:1788652432.522609:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788652432.522620:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875537627809152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652432.522678:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875537627809152:12345-0@lo:400:kworker.0 Request processed in 61us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652432.522687:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788652432.522722:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875537627809024:0@lo:400:kworker.0 00000100:00100000:3.0:1788652432.522759:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652432.522809:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788652432.522818:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f2fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627808896:0@lo:400:kworker.0 00000100:00100000:3.0:1788652432.522849:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652432.522892:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627809024 00000100:00100000:3.0:1788652432.522896:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627809024 00000100:00100000:3.0:1788652432.522930:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627808896 00000100:00100000:3.0:1788652432.522935:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627808896 00000100:00100000:3.0:1788652432.523637:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788652432.523647:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875537627809024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652432.523708:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875537627809024:12345-0@lo:400:kworker.0 Request processed in 63us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652432.523714:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788652432.523726:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788652432.523733:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627808896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652432.523801:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875537627808896:12345-0@lo:400:kworker.0 Request processed in 68us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652432.523808:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788652432.523855:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7f2fa680 x1875537627808896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652432.523868:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875537627808896:0@lo:400:kworker.0 00010000:00080000:3.0:1788652432.523878:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7f2fbb80 x1875537627809024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652432.523886:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875537627809024:0@lo:400:kworker.0 00000100:00100000:3.0:1788652432.523916:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a384a7b-92b2-4f9e-a496-63aebbb65331:3306:1875537627808640:0@lo:400:kworker.0 00010000:00080000:3.0:1788652432.523927:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cbe7f2faa00 x1875537627809152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652432.524048:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875537627809152:0@lo:400:kworker.0 00000100:00080000:1.0:1788652432.524201:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788652432.524207:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788652432.526848:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788652432.526872:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627809280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788652432.526939:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652432.526991:0:15835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627808768 00000100:00100000:2.0:1788652432.526998:0:15835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627808768 00000100:00100000:2.0:1788652432.527113:0:15835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788652432.527133:0:15835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627808768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652432.527193:0:15835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627808768:12345-0@lo:400:kworker.0 Request processed in 67us (5293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652432.527413:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788652432.527430:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f2fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627808768:0@lo:400:kworker.0 00000100:00100000:0.0:1788652432.527500:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627809280 00000100:00100000:0.0:1788652432.527505:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627809280 00000100:00100000:0.0:1788652432.527540:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788652432.527547:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875537627809280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788652432.527575:0:14991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788652432.527621:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875537627809280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652432.527627:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788652432.527713:0:15835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788652432.527734:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788652432.527762:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627809280:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788652432.711967:0:15837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652433.455956:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652433.456052:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603697408 00000100:00100000:0.0:1788652433.456063:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603697408 00000100:00100000:0.0:1788652433.456143:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 75 00000100:00100000:0.0:1788652433.456151:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aafe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2345:x1875537603697408:12345-192.168.203.50@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788652433.456178:0:14299:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from dd83be1f-82a0-4980-8afc-69f413012e95@192.168.203.50@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:0.0:1788652433.456218:0:14299:0:(genops.c:1385:class_connect()) connect: client dd83be1f-82a0-4980-8afc-69f413012e95, cookie 0x340ed74ef02a8901 00000100:00080000:0.0:1788652433.456704:0:14299:0:(import.c:65:import_set_state_nolock()) ffff8cbe819ef000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788652433.456826:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aafe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+5:2345:x1875537603697408:12345-192.168.203.50@tcp:250:mount.lustre.0 Request processed in 673us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652433.456834:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 75 00000100:00100000:2.0:1788652433.468959:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652433.469295:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603697536 00000100:00100000:3.0:1788652433.469305:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603697536 00000100:00100000:3.0:1788652433.469370:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 76 00000100:00100000:3.0:1788652433.469381:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aafc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd83be1f-82a0-4980-8afc-69f413012e95+5:13722:x1875537603697536:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788652433.469398:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652433.469417:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7a0e5600/0x340ed74ef02a8908 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0c25 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652433.469490:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7a0e5600/0x340ed74ef02a8908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c25 expref: 6 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652433.469503:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7a0e5600/0x340ed74ef02a8908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c25 expref: 6 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652433.469514:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5600, rc 0) 00000100:00100000:3.0:1788652433.469837:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aafc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd83be1f-82a0-4980-8afc-69f413012e95+6:13722:x1875537603697536:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 457us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652433.469844:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 76 00000100:00100000:2.0:1788652433.487460:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652433.487557:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603697664 00000100:00100000:0.0:1788652433.487568:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603697664 00000100:00100000:0.0:1788652433.487624:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 77 00000100:00100000:0.0:1788652433.487636:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aafcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+6:13722:x1875537603697664:12345-192.168.203.50@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788652433.487999:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aafcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+6:13722:x1875537603697664:12345-192.168.203.50@tcp:501:mount.lustre.0 Request processed in 364us (546us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788652433.488008:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 77 00000100:00100000:2.0:1788652433.492744:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652433.493006:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603697792 00000100:00100000:0.0:1788652433.493017:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603697792 00000100:00100000:0.0:1788652433.493083:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 78 00000100:00100000:0.0:1788652433.493094:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aafd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd83be1f-82a0-4980-8afc-69f413012e95+6:13722:x1875537603697792:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788652433.493110:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652433.493128:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe75f1a000/0x340ed74ef02a890f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0c2c expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652433.493159:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe75f1a000/0x340ed74ef02a890f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c2c expref: 7 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652433.493170:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe75f1a000/0x340ed74ef02a890f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c2c expref: 7 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652433.493186:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe75f1a000, rc 0) 00000100:00100000:0.0:1788652433.493253:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aafd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd83be1f-82a0-4980-8afc-69f413012e95+7:13722:x1875537603697792:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 161us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652433.493260:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 78 00000100:00100000:2.0:1788652433.496169:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652433.496276:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603697920 00000100:00100000:3.0:1788652433.496285:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603697920 00000100:00100000:3.0:1788652433.496333:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 79 00000100:00100000:3.0:1788652433.496342:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aafc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd83be1f-82a0-4980-8afc-69f413012e95+7:13722:x1875537603697920:12345-192.168.203.50@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788652433.496636:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aafc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd83be1f-82a0-4980-8afc-69f413012e95+8:13722:x1875537603697920:12345-192.168.203.50@tcp:501:mount.lustre.0 Request processed in 294us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652433.496654:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 79 00000100:00100000:3.0:1788652433.511866:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652433.518534:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603698048 00000100:00100000:2.0:1788652433.518551:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603698048 00000100:00100000:2.0:1788652433.518630:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 80 00000100:00100000:2.0:1788652433.518665:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aafdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+8:13722:x1875537603698048:12345-192.168.203.50@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788652433.519014:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aafdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+8:13722:x1875537603698048:12345-192.168.203.50@tcp:503:mount.lustre.0 Request processed in 351us (7156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652433.519024:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 80 00000100:00100000:2.0:1788652433.523697:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652433.523805:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603698176 00000100:00100000:0.0:1788652433.523816:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603698176 00000100:00100000:0.0:1788652433.523872:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 81 00000100:00100000:0.0:1788652433.523882:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aafc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd83be1f-82a0-4980-8afc-69f413012e95+8:13741:x1875537603698176:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788652433.524279:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aafc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd83be1f-82a0-4980-8afc-69f413012e95+8:13741:x1875537603698176:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 397us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652433.524294:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 81 00000100:00100000:0.0:1788652433.550991:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652433.551087:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603698304 00000100:00100000:3.0:1788652433.551097:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603698304 00000100:00100000:3.0:1788652433.551149:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 82 00000100:00100000:3.0:1788652433.551158:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aafd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd83be1f-82a0-4980-8afc-69f413012e95+8:13741:x1875537603698304:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788652433.551456:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aafd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd83be1f-82a0-4980-8afc-69f413012e95+8:13741:x1875537603698304:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 298us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652433.551465:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 82 00000100:00100000:3.0:1788652433.561121:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652433.561203:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603698432 00000100:00100000:2.0:1788652433.561213:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603698432 00000100:00100000:2.0:1788652433.561369:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 83 00000100:00100000:2.0:1788652433.561380:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aafec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+8:13722:x1875537603698432:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788652433.561398:0:14299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652433.561416:0:14299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe75dd1800/0x340ed74ef02a8916 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0c56 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652433.561446:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe75dd1800/0x340ed74ef02a8916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c56 expref: 9 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652433.561459:0:14299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe75dd1800/0x340ed74ef02a8916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c56 expref: 9 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652433.561468:0:14299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe75dd1800, rc 0) 00000100:00100000:2.0:1788652433.561524:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aafec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+9:13722:x1875537603698432:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 146us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652433.561532:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 83 00000100:00100000:2.0:1788652433.567588:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652433.568582:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603698560 00000100:00100000:0.0:1788652433.568595:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603698560 00000100:00100000:0.0:1788652433.568665:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 84 00000100:00100000:0.0:1788652433.568675:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aaff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd83be1f-82a0-4980-8afc-69f413012e95+9:13722:x1875537603698560:12345-192.168.203.50@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788652433.568701:0:14298:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788652433.568724:0:14298:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788652433.568872:0:14298:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788652433.568876:0:14298:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788652433.568878:0:14298:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1788652433.573223:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aaff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd83be1f-82a0-4980-8afc-69f413012e95+9:13722:x1875537603698560:12345-192.168.203.50@tcp:256:mount.lustre.0 Request processed in 4540us (5635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652433.573239:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 84 00000100:00100000:2.0:1788652433.576215:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652433.576372:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603698688 00000100:00100000:0.0:1788652433.576381:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603698688 00000100:00100000:0.0:1788652433.576435:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 85 00000100:00100000:0.0:1788652433.576444:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aaff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+9:13722:x1875537603698688:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788652433.576585:0:14299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652433.576602:0:14299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe75f1be00/0x340ed74ef02a891d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0c5d expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652433.576628:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe75f1be00/0x340ed74ef02a891d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c5d expref: 10 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652433.576639:0:14299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe75f1be00/0x340ed74ef02a891d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c5d expref: 10 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652433.576657:0:14299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe75f1be00, rc 0) 00000100:00100000:0.0:1788652433.576706:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aaff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+10:13722:x1875537603698688:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 263us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652433.576734:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 85 00000100:00100000:0.0:1788652433.580086:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652433.580182:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603698816 00000100:00100000:3.0:1788652433.580192:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603698816 00000100:00100000:3.0:1788652433.580257:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 86 00000100:00100000:3.0:1788652433.580277:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aaff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd83be1f-82a0-4980-8afc-69f413012e95+10:13722:x1875537603698816:12345-192.168.203.50@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788652433.580814:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aaff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd83be1f-82a0-4980-8afc-69f413012e95+10:13722:x1875537603698816:12345-192.168.203.50@tcp:501:mount.lustre.0 Request processed in 537us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652433.580823:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 86 00000100:00100000:1.0:1788652433.584711:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652433.584812:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603698944 00000100:00100000:0.0:1788652433.584822:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603698944 00000100:00100000:0.0:1788652433.584880:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 87 00000100:00100000:0.0:1788652433.584899:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aaffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+10:13722:x1875537603698944:12345-192.168.203.50@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788652433.585275:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aaffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+10:13722:x1875537603698944:12345-192.168.203.50@tcp:503:mount.lustre.0 Request processed in 385us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652433.585284:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 87 00000100:00100000:2.0:1788652433.591879:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652433.593064:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603699072 00000100:00100000:3.0:1788652433.593077:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603699072 00000100:00100000:3.0:1788652433.593132:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 88 00000100:00100000:3.0:1788652433.593142:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aafe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd83be1f-82a0-4980-8afc-69f413012e95+10:13746:x1875537603699072:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788652433.593677:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aafe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd83be1f-82a0-4980-8afc-69f413012e95+10:13746:x1875537603699072:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 534us (1806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652433.593685:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 88 00000100:00100000:2.0:1788652433.598294:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652433.605541:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603699200 00000100:00100000:3.0:1788652433.605555:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603699200 00000100:00100000:0.0:1788652433.611572:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 89 00000100:00100000:0.0:1788652433.611590:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aafe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+10:13746:x1875537603699200:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788652433.612160:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aafe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+10:13746:x1875537603699200:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 573us (13873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652433.612169:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 89 00000100:00100000:1.0:1788652433.624182:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652433.624410:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603699328 00000100:00100000:3.0:1788652433.624420:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603699328 00000100:00100000:3.0:1788652433.625676:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:3.0:1788652433.625687:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2345:x1875537603699328:12345-192.168.203.50@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788652433.625719:0:14304:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c66a6a95-dcf9-4296-ba30-508b18ee8b72@192.168.203.50@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:3.0:1788652433.625786:0:14304:0:(genops.c:1385:class_connect()) connect: client c66a6a95-dcf9-4296-ba30-508b18ee8b72, cookie 0x340ed74ef02a8924 00000004:00100000:3.0:1788652433.625835:0:14304:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788652433.625841:0:14304:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1788652433.679582:0:14304:0:(import.c:65:import_set_state_nolock()) ffff8cbe81ecc800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788652433.679676:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+6:2345:x1875537603699328:12345-192.168.203.50@tcp:38:mount.lustre.0 Request processed in 53987us (55501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652433.679686:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:3.0:1788652433.683246:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652433.683290:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652433.683381:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603699584 00000100:00100000:0.0:1788652433.683391:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603699584 00000100:00100000:0.0:1788652433.683475:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603699456 00000100:00100000:0.0:1788652433.683479:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603699456 00000100:00100000:0.0:1788652433.683504:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:0.0:1788652433.683513:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+7:13722:x1875537603699584:12345-192.168.203.50@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788652433.683556:0:14305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788652433.683638:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+7:13722:x1875537603699584:12345-192.168.203.50@tcp:41:mount.lustre.0 Request processed in 126us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652433.683657:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:0.0:1788652433.683693:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:0.0:1788652433.683700:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+6:0:x1875537603699456:12345-192.168.203.50@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788652433.683712:0:14305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788652433.683744:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+6:0:x1875537603699456:12345-192.168.203.50@tcp:41:mount.lustre.0 Request processed in 44us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652433.683750:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00080000:2.0:1788652433.683899:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652433.686590:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652433.686704:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603699712 00000100:00100000:0.0:1788652433.686714:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603699712 00000100:00100000:0.0:1788652433.686817:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:0.0:1788652433.686828:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+6:13722:x1875537603699712:12345-192.168.203.50@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788652433.687062:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+6:13722:x1875537603699712:12345-192.168.203.50@tcp:40:mount.lustre.0 Request processed in 235us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652433.687070:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:1.0:1788652433.690042:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652433.690087:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652433.690229:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652433.690300:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603700096 00000100:00100000:0.0:1788652433.690311:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603700096 00000100:00100000:0.0:1788652433.690373:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:0.0:1788652433.690385:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+6:13722:x1875537603700096:12345-192.168.203.50@tcp:33:mount.lustre.0 00000100:00100000:2.0:1788652433.692146:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603699840 00000100:00100000:2.0:1788652433.692159:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603699840 00000100:00100000:0.0:1788652433.692275:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603699968 00000100:00100000:0.0:1788652433.692280:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603699968 00000100:00100000:0.0:1788652433.692327:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:0.0:1788652433.692335:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1875537603699968:12345-192.168.203.50@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788652433.692450:0:14987:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c66a6a95-dcf9-4296-ba30-508b18ee8b72@192.168.203.50@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:0.0:1788652433.692494:0:14987:0:(genops.c:1385:class_connect()) connect: client c66a6a95-dcf9-4296-ba30-508b18ee8b72, cookie 0x340ed74ef02a892b 00002000:00100000:0.0:1788652433.692507:0:14987:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c66a6a95-dcf9-4296-ba30-508b18ee8b72/ffff8cbe47141800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788652433.692533:0:14987:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788652433.693372:0:14987:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788652433.693417:0:14987:0:(import.c:65:import_set_state_nolock()) ffff8cbe47147800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788652433.693613:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+6:2345:x1875537603699968:12345-192.168.203.50@tcp:8:mount.lustre.0 Request processed in 1276us (3382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652433.693623:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 6 00000004:00080000:0.0:1788652433.694743:0:14307:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4270us 00000100:00100000:3.0:1788652433.694802:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:3.0:1788652433.694854:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1875537603699840:12345-192.168.203.50@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788652433.694882:0:14990:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c66a6a95-dcf9-4296-ba30-508b18ee8b72@192.168.203.50@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:3.0:1788652433.694911:0:14990:0:(genops.c:1385:class_connect()) connect: client c66a6a95-dcf9-4296-ba30-508b18ee8b72, cookie 0x340ed74ef02a8932 00002000:00100000:3.0:1788652433.694988:0:14990:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c66a6a95-dcf9-4296-ba30-508b18ee8b72/ffff8cbe81ec9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788652433.695000:0:14990:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788652433.695391:0:14990:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788652433.695421:0:14990:0:(import.c:65:import_set_state_nolock()) ffff8cbe81d1f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788652433.695667:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c66a6a95-dcf9-4296-ba30-508b18ee8b72+6:2345:x1875537603699840:12345-192.168.203.50@tcp:8:mount.lustre.0 Request processed in 813us (5578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652433.695676:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 7 00000004:00200000:0.0:1788652433.712339:0:14307:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788652433.712454:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+6:13722:x1875537603700096:12345-192.168.203.50@tcp:33:mount.lustre.0 Request processed in 22066us (22416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652433.712466:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 0 00010000:00010000:2.0:1788652433.736000:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652433.903439:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652433.903523:0:15716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603700224 00000100:00100000:3.0:1788652433.903532:0:15716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603700224 00000100:00100000:3.0:1788652433.903586:0:15716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:3.0:1788652433.903595:0:15716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+6:13767:x1875537603700224:12345-192.168.203.50@tcp:101:mkdir.0 00010000:00010000:3.0:1788652433.903613:0:15716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652433.903689:0:15716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5e00/0x340ed74ef02a8939 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0c87 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652433.903810:0:15716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a8940 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652433.903824:0:15716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a8940 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652433.903839:0:15716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a8940 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652433.903870:0:15716:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788652433.903874:0:15716:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788652433.903908:0:15716:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a8940 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652433.903931:0:15716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5e00/0x340ed74ef02a8939 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c87 expref: 8 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652433.903947:0:15716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a8940 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c87 expref: 7 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652433.903956:0:15716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe7fde3f00) 00010000:00010000:3.0:1788652433.903959:0:15716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788652433.903962:0:15716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5200, rc 0) 00000100:00100000:3.0:1788652433.904018:0:15716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+7:13767:x1875537603700224:12345-192.168.203.50@tcp:101:mkdir.0 Request processed in 425us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652433.904024:0:15716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 8 00000040:00080000:2.0:1788652434.120958:0:14338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1788652434.645976:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c66a6a95-dcf9-4296-ba30-508b18ee8b72 00010000:00010000:2.0:1788652434.761868:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788652435.630547:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c66a6a95-dcf9-4296-ba30-508b18ee8b72 00010000:00010000:0.0:1788652435.783989:0:15837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652435.836291:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652435.836694:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603700352 00000100:00100000:0.0:1788652435.836704:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603700352 00000100:00100000:0.0:1788652435.836810:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:0.0:1788652435.836821:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+7:13819:x1875537603700352:12345-192.168.203.50@tcp:41:lfs.0 00000004:00000024:0.0:1788652435.836865:0:14304:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788652435.836974:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+7:13819:x1875537603700352:12345-192.168.203.50@tcp:41:lfs.0 Request processed in 155us (2646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652435.836982:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00080000:2.0:1788652435.837603:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652435.841157:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652435.841291:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603700480 00000100:00100000:0.0:1788652435.841301:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603700480 00000100:00100000:0.0:1788652435.841370:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:0.0:1788652435.841380:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c66a6a95-dcf9-4296-ba30-508b18ee8b72+5:13819:x1875537603700480:12345-192.168.203.50@tcp:13:lfs.0 00002000:00000024:0.0:1788652435.841434:0:14991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788652435.841620:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c66a6a95-dcf9-4296-ba30-508b18ee8b72+5:13819:x1875537603700480:12345-192.168.203.50@tcp:13:lfs.0 Request processed in 241us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652435.841627:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00080000:2.0:1788652435.842672:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788652435.846160:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652435.846544:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603700608 00000100:00100000:3.0:1788652435.846558:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603700608 00000100:00100000:3.0:1788652435.846655:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:3.0:1788652435.846667:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c66a6a95-dcf9-4296-ba30-508b18ee8b72+5:13819:x1875537603700608:12345-192.168.203.50@tcp:13:lfs.0 00002000:00000024:3.0:1788652435.846718:0:14992:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788652435.846863:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c66a6a95-dcf9-4296-ba30-508b18ee8b72+5:13819:x1875537603700608:12345-192.168.203.50@tcp:13:lfs.0 Request processed in 198us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652435.846872:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00080000:2.0:1788652435.847027:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788652436.004421:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652436.008851:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603700736 00000100:00100000:0.0:1788652436.008866:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603700736 00000100:00100000:0.0:1788652436.008948:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 90 00000100:00100000:0.0:1788652436.008959:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7aafd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd83be1f-82a0-4980-8afc-69f413012e95+10:13852:x1875537603700736:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788652436.008976:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652436.008996:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe75f1bc00/0x340ed74ef02a8947 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0c8e expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652436.009023:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe75f1bc00/0x340ed74ef02a8947 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c8e expref: 11 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652436.009034:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe75f1bc00/0x340ed74ef02a8947 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c8e expref: 11 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652436.009043:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe75f1bc00, rc 0) 00000100:00100000:0.0:1788652436.009108:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7aafd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd83be1f-82a0-4980-8afc-69f413012e95+11:13852:x1875537603700736:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 150us (4695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652436.009115:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 90 00000100:00100000:1.0:1788652436.019209:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652436.019333:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603700864 00000100:00100000:2.0:1788652436.019346:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603700864 00000100:00100000:2.0:1788652436.019425:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 91 00000100:00100000:2.0:1788652436.019437:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81532c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd83be1f-82a0-4980-8afc-69f413012e95+11:13852:x1875537603700864:12345-192.168.203.50@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788652436.019902:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81532c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd83be1f-82a0-4980-8afc-69f413012e95+11:13852:x1875537603700864:12345-192.168.203.50@tcp:501:mount.lustre.0 Request processed in 465us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652436.019912:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 91 00000100:00100000:1.0:1788652436.031624:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652436.031719:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603700992 00000100:00100000:2.0:1788652436.031742:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603700992 00000100:00100000:2.0:1788652436.031849:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 92 00000100:00100000:2.0:1788652436.031862:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81533450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+11:13852:x1875537603700992:12345-192.168.203.50@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788652436.032153:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81533450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+11:13852:x1875537603700992:12345-192.168.203.50@tcp:503:mount.lustre.0 Request processed in 293us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652436.032162:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 92 00000100:00100000:3.0:1788652436.041369:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652436.041501:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603701120 00000100:00100000:0.0:1788652436.041515:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603701120 00000100:00100000:0.0:1788652436.041590:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 93 00000100:00100000:0.0:1788652436.041602:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81533850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd83be1f-82a0-4980-8afc-69f413012e95+11:13858:x1875537603701120:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788652436.042041:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81533850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd83be1f-82a0-4980-8afc-69f413012e95+11:13858:x1875537603701120:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 440us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652436.042058:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 93 00000100:00100000:1.0:1788652436.064975:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652436.065163:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603701248 00000100:00100000:2.0:1788652436.065178:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603701248 00000100:00100000:2.0:1788652436.065492:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 94 00000100:00100000:2.0:1788652436.065525:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81533050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+11:13858:x1875537603701248:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788652436.066933:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81533050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+11:13858:x1875537603701248:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 1402us (1964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652436.066948:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 94 00000100:00100000:1.0:1788652436.070502:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652436.070666:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603701376 00000100:00100000:2.0:1788652436.070680:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603701376 00000100:00100000:2.0:1788652436.070763:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 95 00000100:00100000:2.0:1788652436.070806:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81533c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd83be1f-82a0-4980-8afc-69f413012e95+11:13852:x1875537603701376:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788652436.070827:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652436.070851:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe75dd1400/0x340ed74ef02a894e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0cb8 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652436.070888:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe75dd1400/0x340ed74ef02a894e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0cb8 expref: 12 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652436.070901:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe75dd1400/0x340ed74ef02a894e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0cb8 expref: 12 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652436.070911:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe75dd1400, rc 0) 00000100:00100000:2.0:1788652436.070986:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81533c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd83be1f-82a0-4980-8afc-69f413012e95+12:13852:x1875537603701376:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 214us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652436.070994:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 95 00000100:00100000:3.0:1788652436.074918:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652436.075230:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603701504 00000100:00100000:2.0:1788652436.075242:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603701504 00000100:00100000:2.0:1788652436.075317:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 96 00000100:00100000:2.0:1788652436.075329:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+12:13852:x1875537603701504:12345-192.168.203.50@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788652436.075380:0:14299:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788652436.075400:0:14299:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788652436.075404:0:14299:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788652436.075408:0:14299:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788652436.075411:0:14299:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788652436.078192:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+12:13852:x1875537603701504:12345-192.168.203.50@tcp:256:mount.lustre.0 Request processed in 2840us (3266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652436.078213:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 96 00000100:00100000:1.0:1788652436.081257:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652436.081515:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603701632 00000100:00100000:2.0:1788652436.081527:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603701632 00000100:00100000:2.0:1788652436.081590:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 97 00000100:00100000:2.0:1788652436.081602:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81532850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd83be1f-82a0-4980-8afc-69f413012e95+12:13852:x1875537603701632:12345-192.168.203.50@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788652436.081622:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652436.081656:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe75dd1200/0x340ed74ef02a8955 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0cbf expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652436.081693:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe75dd1200/0x340ed74ef02a8955 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0cbf expref: 13 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652436.081706:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe75dd1200/0x340ed74ef02a8955 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0cbf expref: 13 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652436.081717:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe75dd1200, rc 0) 00000100:00100000:2.0:1788652436.081828:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81532850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd83be1f-82a0-4980-8afc-69f413012e95+13:13852:x1875537603701632:12345-192.168.203.50@tcp:101:mount.lustre.0 Request processed in 227us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652436.081837:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 97 00000100:00100000:3.0:1788652436.084522:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652436.084930:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603701760 00000100:00100000:2.0:1788652436.084968:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603701760 00000100:00100000:2.0:1788652436.085496:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 98 00000100:00100000:2.0:1788652436.085509:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81531450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+13:13852:x1875537603701760:12345-192.168.203.50@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788652436.086578:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81531450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+13:13852:x1875537603701760:12345-192.168.203.50@tcp:501:mount.lustre.0 Request processed in 1063us (2061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652436.086590:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 98 00000100:00100000:1.0:1788652436.089671:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652436.090140:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603701888 00000100:00100000:0.0:1788652436.090154:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603701888 00000100:00100000:0.0:1788652436.090340:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 99 00000100:00100000:0.0:1788652436.090352:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd83be1f-82a0-4980-8afc-69f413012e95+13:13852:x1875537603701888:12345-192.168.203.50@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788652436.090680:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd83be1f-82a0-4980-8afc-69f413012e95+13:13852:x1875537603701888:12345-192.168.203.50@tcp:503:mount.lustre.0 Request processed in 330us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652436.090689:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 99 00000100:00100000:1.0:1788652436.093589:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652436.095065:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603702016 00000100:00100000:2.0:1788652436.095085:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603702016 00000100:00100000:2.0:1788652436.095178:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 100 00000100:00100000:2.0:1788652436.095194:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81530450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+13:13861:x1875537603702016:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788652436.096984:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81530450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+13:13861:x1875537603702016:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 1779us (3393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652436.097001:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 100 00000100:00100000:3.0:1788652436.101838:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652436.102070:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603702144 00000100:00100000:0.0:1788652436.102085:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603702144 00000100:00100000:0.0:1788652436.102166:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 101 00000100:00100000:0.0:1788652436.102179:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81530c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd83be1f-82a0-4980-8afc-69f413012e95+13:13861:x1875537603702144:12345-192.168.203.50@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788652436.102534:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81530c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd83be1f-82a0-4980-8afc-69f413012e95+13:13861:x1875537603702144:12345-192.168.203.50@tcp:502:llog_process_th.0 Request processed in 357us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652436.102544:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 101 00000100:00100000:1.0:1788652436.120932:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652436.121080:0:15716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603702272 00000100:00100000:3.0:1788652436.121095:0:15716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603702272 00000100:00100000:3.0:1788652436.121232:0:15716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:3.0:1788652436.121243:0:15716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2345:x1875537603702272:12345-192.168.203.50@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788652436.121622:0:15716:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 8fbfa306-1be4-498a-9298-3679b70726ba@192.168.203.50@tcp t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:3.0:1788652436.121687:0:15716:0:(genops.c:1385:class_connect()) connect: client 8fbfa306-1be4-498a-9298-3679b70726ba, cookie 0x340ed74ef02a895c 00000004:00100000:3.0:1788652436.121740:0:15716:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788652436.122058:0:15716:0:(import.c:65:import_set_state_nolock()) ffff8cbe7f382000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788652436.122222:0:15716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fbfa306-1be4-498a-9298-3679b70726ba+6:2345:x1875537603702272:12345-192.168.203.50@tcp:38:mount.lustre.0 Request processed in 978us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652436.122233:0:15716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:1.0:1788652436.125855:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652436.125895:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652436.125954:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603702400 00000100:00100000:3.0:1788652436.125968:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603702400 00000100:00100000:0.0:1788652436.126058:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603702528 00000100:00100000:0.0:1788652436.126064:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603702528 00000100:00080000:2.0:1788652436.126139:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652436.126665:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:3.0:1788652436.126684:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fbfa306-1be4-498a-9298-3679b70726ba+7:0:x1875537603702400:12345-192.168.203.50@tcp:41:mount.lustre.0 00000100:00100000:0.0:1788652436.126721:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:0.0:1788652436.126742:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fbfa306-1be4-498a-9298-3679b70726ba+7:13852:x1875537603702528:12345-192.168.203.50@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788652436.126759:0:14305:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000004:00000024:0.0:1788652436.126759:0:14304:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788652436.126908:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fbfa306-1be4-498a-9298-3679b70726ba+7:13852:x1875537603702528:12345-192.168.203.50@tcp:41:mount.lustre.0 Request processed in 179us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652436.126917:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:3.0:1788652436.130234:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fbfa306-1be4-498a-9298-3679b70726ba+6:0:x1875537603702400:12345-192.168.203.50@tcp:41:mount.lustre.0 Request processed in 3475us (4312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652436.130252:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:2.0:1788652436.130418:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652436.131101:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603702656 00000100:00100000:0.0:1788652436.131131:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603702656 00000100:00100000:0.0:1788652436.131253:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:0.0:1788652436.131265:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fbfa306-1be4-498a-9298-3679b70726ba+6:13852:x1875537603702656:12345-192.168.203.50@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788652436.131491:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fbfa306-1be4-498a-9298-3679b70726ba+6:13852:x1875537603702656:12345-192.168.203.50@tcp:40:mount.lustre.0 Request processed in 227us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652436.131500:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:2.0:1788652436.135209:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652436.135250:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652436.135288:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603702784 00000100:00100000:2.0:1788652436.135289:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652436.135301:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603702784 00000100:00100000:1.0:1788652436.135351:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603702912 00000100:00100000:1.0:1788652436.135355:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603702912 00000100:00100000:1.0:1788652436.135375:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:3.0:1788652436.135500:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603703040 00000100:00100000:3.0:1788652436.135505:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603703040 00000100:00100000:1.0:1788652436.135535:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1875537603702784:12345-192.168.203.50@tcp:8:mount.lustre.0 00000100:00100000:3.0:1788652436.135553:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 1 00000100:00100000:3.0:1788652436.135560:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8fbfa306-1be4-498a-9298-3679b70726ba+6:13852:x1875537603703040:12345-192.168.203.50@tcp:33:mount.lustre.0 00010000:00080000:1.0:1788652436.135576:0:14989:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 8fbfa306-1be4-498a-9298-3679b70726ba@192.168.203.50@tcp t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:1.0:1788652436.135616:0:14989:0:(genops.c:1385:class_connect()) connect: client 8fbfa306-1be4-498a-9298-3679b70726ba, cookie 0x340ed74ef02a8963 00002000:00100000:1.0:1788652436.135643:0:14989:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8fbfa306-1be4-498a-9298-3679b70726ba/ffff8cbe75973800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788652436.135657:0:14989:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000004:00200000:3.0:1788652436.135661:0:14308:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788652436.135788:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8fbfa306-1be4-498a-9298-3679b70726ba+6:13852:x1875537603703040:12345-192.168.203.50@tcp:33:mount.lustre.0 Request processed in 209us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652436.135798:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 1 00000100:00100000:3.0:1788652436.135827:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:3.0:1788652436.135832:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1875537603702912:12345-192.168.203.50@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788652436.135849:0:14990:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 8fbfa306-1be4-498a-9298-3679b70726ba@192.168.203.50@tcp t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:3.0:1788652436.135872:0:14990:0:(genops.c:1385:class_connect()) connect: client 8fbfa306-1be4-498a-9298-3679b70726ba, cookie 0x340ed74ef02a896a 00002000:00100000:3.0:1788652436.135878:0:14990:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8fbfa306-1be4-498a-9298-3679b70726ba/ffff8cbe7f387800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788652436.135885:0:14990:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788652436.136241:0:14990:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788652436.136300:0:14990:0:(import.c:65:import_set_state_nolock()) ffff8cbe495ea000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788652436.136336:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8fbfa306-1be4-498a-9298-3679b70726ba+6:2345:x1875537603702912:12345-192.168.203.50@tcp:8:mount.lustre.0 Request processed in 502us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652436.136354:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 9 00002000:00080000:1.0:1788652436.137103:0:14989:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788652436.137132:0:14989:0:(import.c:65:import_set_state_nolock()) ffff8cbe75976000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788652436.137246:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8fbfa306-1be4-498a-9298-3679b70726ba+6:2345:x1875537603702784:12345-192.168.203.50@tcp:8:mount.lustre.0 Request processed in 1712us (2100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652436.137256:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:1.0:1788652436.326287:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652436.326746:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603703168 00000100:00100000:0.0:1788652436.326920:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603703168 00000100:00100000:0.0:1788652436.327008:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00100000:0.0:1788652436.327369:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fbfa306-1be4-498a-9298-3679b70726ba+6:13882:x1875537603703168:12345-192.168.203.50@tcp:101:mkdir.0 00010000:00010000:0.0:1788652436.327496:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652436.327530:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1ae00/0x340ed74ef02a8971 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0ce9 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652436.327620:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1aa00/0x340ed74ef02a8978 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652436.327649:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1aa00/0x340ed74ef02a8978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652436.327667:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1aa00/0x340ed74ef02a8978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652436.327709:0:14306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788652436.327713:0:14306:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788652436.327748:0:14306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1aa00/0x340ed74ef02a8978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652436.328089:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1ae00/0x340ed74ef02a8971 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ce9 expref: 8 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652436.328129:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1aa00/0x340ed74ef02a8978 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ce9 expref: 7 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652436.328138:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe7fde3f00) 00010000:00010000:0.0:1788652436.328141:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788652436.328146:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe75f1aa00, rc 0) 00000100:00100000:1.0:1788652436.328580:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fbfa306-1be4-498a-9298-3679b70726ba+7:13882:x1875537603703168:12345-192.168.203.50@tcp:101:mkdir.0 Request processed in 1556us (2301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652436.328591:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 14 00010000:00010000:2.0:1788652436.808469:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652437.643254:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788652437.643278:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627809408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788652437.643344:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652437.643599:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd41faad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627809920:0@lo:400:kworker.0 00000100:00100000:3.0:1788652437.643600:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd41fab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875537627809792:0@lo:400:kworker.0 00000100:00100000:3.0:1788652437.643659:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652437.643690:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652437.643694:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788652437.643702:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd41fab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627809664:0@lo:400:kworker.0 00000100:00100000:1.0:1788652437.643721:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788652437.643730:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd41fa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a384a7b-92b2-4f9e-a496-63aebbb65331:3303:1875537627809536:0@lo:400:kworker.0 00000100:00100000:1.0:1788652437.643762:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652437.643813:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652437.643854:0:15716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627809792 00000100:00100000:3.0:1788652437.643862:0:15716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627809792 00000100:00100000:1.0:1788652437.643884:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd41fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875537627810048:0@lo:400:kworker.0 00000100:00100000:3.0:1788652437.643904:0:15716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627809920 00000100:00100000:3.0:1788652437.643909:0:15716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627809920 00000100:00100000:1.0:1788652437.643920:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652437.643938:0:15716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627810048 00000100:00100000:3.0:1788652437.643941:0:15716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627810048 00000100:00100000:3.0:1788652437.643959:0:15716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788652437.643967:0:15716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875537627809792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652437.644022:0:15716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875537627809792:12345-0@lo:400:kworker.0 Request processed in 55us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652437.644027:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788652437.644035:0:15716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788652437.644040:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627809920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652437.644056:0:15716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788652437.644066:0:15716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875537627810048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652437.644086:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875537627809920:12345-0@lo:400:kworker.0 Request processed in 49us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652437.644094:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788652437.644107:0:15716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875537627810048:12345-0@lo:400:kworker.0 Request processed in 42us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652437.644116:0:15716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788652437.644119:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627809536 00000100:00100000:1.0:1788652437.644125:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627809536 00000100:00100000:3.0:1788652437.644143:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627809664 00000100:00100000:3.0:1788652437.644161:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627809664 00000100:00100000:1.0:1788652437.644161:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788652437.644174:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81531050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:3303:x1875537627809536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652437.644332:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788652437.644339:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81531050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:3303:x1875537627809536:12345-0@lo:400:kworker.0 Request processed in 167us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652437.644344:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627809664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652437.644358:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788652437.644391:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627809664:12345-0@lo:400:kworker.0 Request processed in 51us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652437.644399:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788652437.644422:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd41fa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a384a7b-92b2-4f9e-a496-63aebbb65331:3303:1875537627809536:0@lo:400:kworker.0 00000100:00100000:1.0:1788652437.644440:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd41fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875537627810048:0@lo:400:kworker.0 00000100:00100000:1.0:1788652437.644451:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd41faad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875537627809920:0@lo:400:kworker.0 00000100:00080000:3.0:1788652437.644470:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788652437.644476:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788652437.644548:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627809408 00000100:00100000:0.0:1788652437.644553:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627809408 00000100:00100000:2.0:1788652437.644699:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627810176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788652437.644729:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652437.644871:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd41fab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627809664:0@lo:400:kworker.0 00000100:00100000:2.0:1788652437.644884:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd41fab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875537627809792:0@lo:400:kworker.0 00000100:00100000:1.0:1788652437.645021:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627810176 00000100:00100000:1.0:1788652437.645027:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627810176 00000100:00100000:1.0:1788652437.645050:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788652437.645057:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627810176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788652437.645086:0:14991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788652437.645193:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627810176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652437.645277:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788652437.645296:0:14991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788652437.645305:0:14991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627809408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788652437.645325:0:14991:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788652437.645416:0:14991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627809408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (2071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652437.645424:0:14991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788652437.645430:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788652437.650047:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627810176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788652437.651729:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627809408:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788652437.832111:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788652438.728502:0:16270:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1788652438.730907:0:5857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8fbfa306-1be4-498a-9298-3679b70726ba 00000001:00100000:2.0:1788652438.730930:0:5857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c66a6a95-dcf9-4296-ba30-508b18ee8b72 00010000:00010000:1.0:1788652438.864519:0:15837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788652439.738232:0:6704:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8fbfa306-1be4-498a-9298-3679b70726ba 00010000:00010000:3.0:1788652439.882397:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788652440.786739:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8fbfa306-1be4-498a-9298-3679b70726ba 00010000:00010000:2.0:1788652440.903867:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652441.265277:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652441.265324:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652441.265349:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652441.265370:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652441.265440:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652441.265467:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603703552 00000100:00100000:0.0:1788652441.265476:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603703552 00000100:00100000:0.0:1788652441.265530:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603704064 00000100:00100000:0.0:1788652441.265533:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603704064 00000100:00100000:0.0:1788652441.265558:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:0.0:1788652441.265568:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+5:2347:x1875537603703552:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1788652441.265651:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+5:2347:x1875537603703552:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 84us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652441.265658:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:0.0:1788652441.265675:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:0.0:1788652441.265692:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8fbfa306-1be4-498a-9298-3679b70726ba+5:2347:x1875537603704064:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1788652441.265719:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8fbfa306-1be4-498a-9298-3679b70726ba+5:2347:x1875537603704064:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 27us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652441.265725:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:3.0:1788652441.266164:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603703424 00000100:00100000:3.0:1788652441.266170:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603703424 00000100:00100000:3.0:1788652441.266202:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603703808 00000100:00100000:3.0:1788652441.266206:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603703808 00000100:00100000:3.0:1788652441.266239:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:3.0:1788652441.266247:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+6:2346:x1875537603703424:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1788652441.266387:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+6:2346:x1875537603703424:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 139us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652441.266395:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:3.0:1788652441.266411:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:3.0:1788652441.266419:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fbfa306-1be4-498a-9298-3679b70726ba+6:2347:x1875537603703808:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1788652441.266444:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fbfa306-1be4-498a-9298-3679b70726ba+6:2347:x1875537603703808:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 27us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652441.266450:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00080000:3.0:1788652441.266471:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788652441.266475:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788652441.266485:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788652441.266528:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652441.266576:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652441.266648:0:15835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603703680 00000100:00100000:3.0:1788652441.266652:0:15835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603703680 00000100:00100000:3.0:1788652441.266682:0:15835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603703936 00000100:00100000:3.0:1788652441.266685:0:15835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603703936 00000100:00100000:3.0:1788652441.266705:0:15835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:3.0:1788652441.266713:0:15835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+5:2346:x1875537603703680:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1788652441.266757:0:15835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+5:2346:x1875537603703680:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 45us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652441.266764:0:15835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:3.0:1788652441.266810:0:15835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:3.0:1788652441.266818:0:15835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8fbfa306-1be4-498a-9298-3679b70726ba+5:2346:x1875537603703936:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:3.0:1788652441.266841:0:15835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8fbfa306-1be4-498a-9298-3679b70726ba+5:2346:x1875537603703936:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 24us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652441.266847:0:15835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00080000:3.0:1788652441.266864:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788652441.266867:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788652441.269171:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603703296 00000100:00100000:2.0:1788652441.269184:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603703296 00000100:00100000:2.0:1788652441.269241:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 103 00000100:00100000:2.0:1788652441.269252:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81530850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd83be1f-82a0-4980-8afc-69f413012e95+13:2347:x1875537603703296:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652441.269324:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81530850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd83be1f-82a0-4980-8afc-69f413012e95+13:2347:x1875537603703296:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 74us (3999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652441.269332:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 103 00000020:00000080:0.0:1788652441.821272:0:16421:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe213a8860 20000000:00000080:0.0:1788652441.821293:0:16421:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cbd426c7c00 uarg=0000000000000000 20000000:01000000:0.0:1788652441.821335:0:16421:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788652441.821342:0:16421:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788652441.821347:0:16421:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788652441.823091:0:16422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788652441.823395:0:16421:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788652441.830454:0:16421:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788652441.830484:0:16421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cbe75f1a400/0x340ed74ef02a897f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652441.830504:0:16421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe7a0e5400/0x340ed74ef02a8676 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a866f expref: 18 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652441.830513:0:16421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe7a0c9c00/0x340ed74ef02a86c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a86bc expref: 18 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652441.830520:0:16421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe7fd10800/0x340ed74ef02a8733 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a872c expref: 18 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652441.830529:0:16421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe75f1be00/0x340ed74ef02a891d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c5d expref: 12 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652441.830536:0:16421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cbe75dd1200/0x340ed74ef02a8955 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0cbf expref: 12 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652441.830543:0:16421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cbe75f1a400/0x340ed74ef02a897f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652441.830605:0:16421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe75dd1200/0x340ed74ef02a8955 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0cbf expref: 12 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652441.830621:0:16421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe75dd1200/0x340ed74ef02a8955 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0cbf expref: 12 pid: 14297 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652441.830636:0:16421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16421:1875537627810304:192.168.203.50@tcp:104: 00010000:00010000:0.0:1788652441.830733:0:16421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe75f1be00/0x340ed74ef02a891d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c5d expref: 12 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652441.830742:0:16421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe75f1be00/0x340ed74ef02a891d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c5d expref: 12 pid: 14299 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652441.830750:0:16421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16421:1875537627810432:192.168.203.50@tcp:104: 00010000:00010000:0.0:1788652441.830801:0:16421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe7fd10800/0x340ed74ef02a8733 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a872c expref: 18 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652441.830809:0:16421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe7fd10800/0x340ed74ef02a8733 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a872c expref: 18 pid: 14297 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652441.830818:0:16421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16421:1875537627810560:0@lo:104: 00000100:00100000:0.0:1788652441.830853:0:16421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788652441.830889:0:16421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe7a0c9c00/0x340ed74ef02a86c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a86bc expref: 18 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652441.830897:0:16421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe7a0c9c00/0x340ed74ef02a86c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a86bc expref: 18 pid: 14298 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652441.830917:0:16421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8fa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16421:1875537627810688:0@lo:104: 00000100:00100000:0.0:1788652441.830940:0:16421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788652441.830962:0:16421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cbe7a0e5400/0x340ed74ef02a8676 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x340ed74ef02a866f expref: 18 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652441.830970:0:16421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cbe7a0e5400/0x340ed74ef02a8676 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x340ed74ef02a866f expref: 18 pid: 14298 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652441.830978:0:16421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8fad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16421:1875537627810816:0@lo:104: 00000100:00100000:0.0:1788652441.831002:0:16421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652441.831012:0:16421:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4f38f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652441.831124:0:14287:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788652441.831139:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627810560 00000100:00100000:1.0:1788652441.831145:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627810560 00000100:00100000:1.0:1788652441.831179:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627810688 00000100:00100000:1.0:1788652441.831181:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627810688 00000100:00100000:1.0:1788652441.831201:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627810816 00000100:00100000:1.0:1788652441.831203:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627810816 00000100:00100000:1.0:1788652441.831215:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788652441.831223:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a384a7b-92b2-4f9e-a496-63aebbb65331+5:16421:x1875537627810560:12345-0@lo:104: 00010000:00010000:1.0:1788652441.831235:0:14287:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a872c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a8733 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.831285:0:14287:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788652441.831291:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a384a7b-92b2-4f9e-a496-63aebbb65331+5:16421:x1875537627810560:12345-0@lo:104: Request processed in 69us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652441.831298:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788652441.831314:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788652441.831321:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a384a7b-92b2-4f9e-a496-63aebbb65331+4:16421:x1875537627810688:12345-0@lo:104: 00010000:00010000:1.0:1788652441.831328:0:14287:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a86bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a86c3 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.831360:0:14287:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788652441.831365:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a384a7b-92b2-4f9e-a496-63aebbb65331+4:16421:x1875537627810688:12345-0@lo:104: Request processed in 46us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652441.831370:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788652441.831382:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788652441.831388:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7fd0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a384a7b-92b2-4f9e-a496-63aebbb65331+3:16421:x1875537627810816:12345-0@lo:104: 00010000:00010000:1.0:1788652441.831395:0:14287:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e200/0x340ed74ef02a866f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a8676 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.831424:0:14287:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788652441.831429:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7fd0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a384a7b-92b2-4f9e-a496-63aebbb65331+3:16421:x1875537627810816:12345-0@lo:104: Request processed in 42us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652441.831445:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788652441.831481:0:15837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788652441.831487:0:15837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a872c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a8733 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.831495:0:15837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215ee00 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:1.0:1788652441.831499:0:15837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a872c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a8733 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.831509:0:15837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a872c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a8733 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788652441.831516:0:15837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a872c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a8733 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652441.831522:0:15837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788652441.831548:0:15837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a872c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a8733 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.831555:0:15837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788652441.831571:0:15837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a872c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a8733 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.831577:0:15837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe8215ee00/0x340ed74ef02a872c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a8733 expref: -99 pid: 15703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.831602:0:15837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788652441.831606:0:15837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a86bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a86c3 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.831622:0:15837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4200 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:1.0:1788652441.831625:0:15837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a86bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a86c3 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.831631:0:15837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a86bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a86c3 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788652441.831637:0:15837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a86bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a86c3 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652441.831642:0:15837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788652441.831654:0:15837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a86bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a86c3 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.831660:0:15837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788652441.831677:0:15837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a86bc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a86c3 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.831683:0:15837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe7a0e4200/0x340ed74ef02a86bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a86c3 expref: -99 pid: 14986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.831692:0:15837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652441.831695:0:15837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e200/0x340ed74ef02a866f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x340ed74ef02a8676 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.831700:0:15837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe8215e200 already unused, calling callback (ffffffffc1dd0c20) 10000000:00010000:1.0:1788652441.831703:0:15837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e200/0x340ed74ef02a866f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x340ed74ef02a8676 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.831719:0:15837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e200/0x340ed74ef02a866f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x340ed74ef02a8676 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788652441.831725:0:15837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e200/0x340ed74ef02a866f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x340ed74ef02a8676 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652441.831731:0:15837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788652441.831744:0:15837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e200/0x340ed74ef02a866f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a8676 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.831749:0:15837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788652441.831756:0:15837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e200/0x340ed74ef02a866f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a8676 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.831762:0:15837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.150@tcp lock: ffff8cbe8215e200/0x340ed74ef02a866f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x340ed74ef02a8676 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.831798:0:15837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652441.831800:0:15837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652441.831802:0:15837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652441.831814:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f82d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a384a7b-92b2-4f9e-a496-63aebbb65331:3303:1875537627811072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788652441.831843:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652441.831864:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788652441.831869:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f82c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a384a7b-92b2-4f9e-a496-63aebbb65331:3303:1875537627811200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788652441.831885:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652441.831916:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627811072 00000100:00100000:1.0:1788652441.831921:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627811072 00010000:00010000:1.0:1788652441.831940:0:14290:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe7a0c9c00/0x340ed74ef02a86c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a86bc expref: 19 pid: 14298 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652441.831972:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627811200 00000100:00100000:1.0:1788652441.831976:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627811200 00010000:00010000:1.0:1788652441.831991:0:14290:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe7a0e5400/0x340ed74ef02a8676 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a866f expref: 20 pid: 14298 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652441.832003:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788652441.832009:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a384a7b-92b2-4f9e-a496-63aebbb65331+20:3303:x1875537627811072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788652441.832017:0:14290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652441.832022:0:14290:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe7a0c9c00/0x340ed74ef02a86c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a86bc expref: 20 pid: 14298 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.832031:0:14290:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe7a0c9c00/0x340ed74ef02a86c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a86bc expref: 20 pid: 14298 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.832046:0:14290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652441.832075:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a384a7b-92b2-4f9e-a496-63aebbb65331+20:3303:x1875537627811072:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652441.832082:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788652441.832095:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788652441.832100:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:3303:x1875537627811200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788652441.832107:0:14290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652441.832110:0:14290:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe7a0e5400/0x340ed74ef02a8676 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a866f expref: 19 pid: 14298 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.832118:0:14290:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe7a0e5400/0x340ed74ef02a8676 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a866f expref: 19 pid: 14298 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.832126:0:14290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652441.832151:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:3303:x1875537627811200:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652441.832157:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788652441.832191:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f82c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a384a7b-92b2-4f9e-a496-63aebbb65331:3303:1875537627811200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788652441.832198:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f82d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a384a7b-92b2-4f9e-a496-63aebbb65331:3303:1875537627811072:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788652441.832366:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652441.832863:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652441.832884:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f82d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a384a7b-92b2-4f9e-a496-63aebbb65331:3306:1875537627810944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652441.832920:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652441.833455:0:16421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16421:1875537627810560:0@lo:104: 00010000:00010000:0.0:1788652441.833466:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe7a0c9c00/0x340ed74ef02a86c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a86bc expref: 18 pid: 14298 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652441.833480:0:16421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8fa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16421:1875537627810688:0@lo:104: 00010000:00010000:0.0:1788652441.833488:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe7a0e5400/0x340ed74ef02a8676 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a866f expref: 17 pid: 14298 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652441.833495:0:16421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8fad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16421:1875537627810816:0@lo:104: 00000100:00100000:1.0:1788652441.833566:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627810944 00000100:00100000:1.0:1788652441.833571:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627810944 00010000:00010000:1.0:1788652441.833607:0:14290:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe7fd10800/0x340ed74ef02a8733 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a872c expref: 17 pid: 14297 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652441.833637:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788652441.833645:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f174c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a384a7b-92b2-4f9e-a496-63aebbb65331+17:3306:x1875537627810944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788652441.833655:0:14290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652441.833659:0:14290:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe7fd10800/0x340ed74ef02a8733 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x340ed74ef02a872c expref: 17 pid: 14297 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.833668:0:14290:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe7fd10800/0x340ed74ef02a8733 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x340ed74ef02a872c expref: 17 pid: 14297 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.833682:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe7fd10800/0x340ed74ef02a8733 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x340ed74ef02a872c expref: 17 pid: 14297 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.833694:0:14290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652441.833737:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f174c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:3306:x1875537627810944:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652441.833744:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788652441.834796:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f82d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a384a7b-92b2-4f9e-a496-63aebbb65331:3306:1875537627810944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652441.838054:0:16421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16421:1875537627810304:192.168.203.50@tcp:104: 00000100:00100000:2.0:1788652441.838070:0:16421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16421:1875537627810432:192.168.203.50@tcp:104: 00010000:00010000:2.0:1788652441.838103:0:16421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cbe75f1a400/0x340ed74ef02a897f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652441.838527:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652441.838560:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652441.838641:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603704320 00000100:00100000:1.0:1788652441.838650:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603704320 00010000:00010000:1.0:1788652441.838699:0:14289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe75f1be00/0x340ed74ef02a891d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c5d expref: 13 pid: 14299 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652441.838736:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603704192 00000100:00100000:1.0:1788652441.838740:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603704192 00010000:00010000:1.0:1788652441.838752:0:14289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cbe75dd1200/0x340ed74ef02a8955 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0cbf expref: 14 pid: 14297 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652441.838795:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:1.0:1788652441.838806:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd83be1f-82a0-4980-8afc-69f413012e95+14:2347:x1875537603704320:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652441.838820:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652441.838827:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe75f1be00/0x340ed74ef02a891d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c5d expref: 14 pid: 14299 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.838838:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe75f1be00/0x340ed74ef02a891d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c5d expref: 14 pid: 14299 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.838855:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe75f1be00/0x340ed74ef02a891d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c5d expref: 14 pid: 14299 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.838872:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652441.838925:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd83be1f-82a0-4980-8afc-69f413012e95+13:2347:x1875537603704320:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 121us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652441.838933:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:1.0:1788652441.838951:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:1.0:1788652441.838958:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd83be1f-82a0-4980-8afc-69f413012e95+12:2347:x1875537603704192:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652441.838966:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652441.838971:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cbe75dd1200/0x340ed74ef02a8955 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0cbf expref: 12 pid: 14297 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.838988:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cbe75dd1200/0x340ed74ef02a8955 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0cbf expref: 12 pid: 14297 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.838999:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe75dd1200/0x340ed74ef02a8955 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0cbf expref: 12 pid: 14297 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.839010:0:14289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cbe75f1a400/0x340ed74ef02a897f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.839019:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe75f1a400/0x340ed74ef02a897f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.839034:0:14289:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe75f1a400/0x340ed74ef02a897f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.839042:0:14289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cbe75f1a400/0x340ed74ef02a897f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.839049:0:14289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cbe75f1a400/0x340ed74ef02a897f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.839056:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cbe75f1a400/0x340ed74ef02a897f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.839062:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75f1a400 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:1.0:1788652441.839067:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cbe75f1a400/0x340ed74ef02a897f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.839075:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cbe75f1a400/0x340ed74ef02a897f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.839100:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cbe75f1a400/0x340ed74ef02a897f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652441.839110:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652441.839147:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd83be1f-82a0-4980-8afc-69f413012e95+11:2347:x1875537603704192:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 189us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652441.839154:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 8 00010000:00010000:2.0:1788652441.839293:0:16421:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cbe75f1a400/0x340ed74ef02a897f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652441.839301:0:16421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cbe75f1a400/0x340ed74ef02a897f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652441.839306:0:16421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cbe75f1a400/0x340ed74ef02a897f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652441.928933:0:15837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652442.760522:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788652442.760546:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627811328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788652442.760621:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652442.760767:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627811328 00000100:00100000:0.0:1788652442.760802:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627811328 00000100:00100000:0.0:1788652442.760858:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788652442.760868:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41faa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627811328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788652442.760901:0:14992:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788652442.760959:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41faa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875537627811328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652442.760976:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788652442.761024:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875537627811328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788652442.761105:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627811584:0@lo:400:kworker.0 00000100:00100000:0.0:1788652442.761131:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652442.761150:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788652442.761156:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627811712:0@lo:400:kworker.0 00000100:00100000:0.0:1788652442.761178:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652442.761206:0:15835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627811584 00000100:00100000:0.0:1788652442.761210:0:15835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627811584 00000100:00100000:0.0:1788652442.761238:0:15835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788652442.761245:0:15835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627811584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652442.761278:0:15835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627811584:12345-0@lo:400:kworker.0 Request processed in 34us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652442.761285:0:15835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788652442.761302:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627811712 00000100:00100000:0.0:1788652442.761305:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627811712 00000100:00100000:0.0:1788652442.761330:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788652442.761336:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627811712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652442.761364:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875537627811712:12345-0@lo:400:kworker.0 Request processed in 29us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652442.761370:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788652442.761398:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875537627811712:0@lo:400:kworker.0 00000100:00100000:0.0:1788652442.761407:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627811584:0@lo:400:kworker.0 00000100:00100000:0.0:1788652442.761422:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a384a7b-92b2-4f9e-a496-63aebbb65331:3306:1875537627811456:0@lo:400:kworker.0 00000100:00100000:0.0:1788652442.761457:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652442.761480:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875537627811968:0@lo:400:kworker.0 00000100:00100000:0.0:1788652442.761501:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652442.761518:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788652442.761523:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875537627811840:0@lo:400:kworker.0 00000100:00100000:0.0:1788652442.761542:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652442.761566:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627811456 00000100:00100000:0.0:1788652442.761570:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627811456 00000100:00100000:0.0:1788652442.761607:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788652442.761614:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81531c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:3306:x1875537627811456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652442.761647:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81531c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:3306:x1875537627811456:12345-0@lo:400:kworker.0 Request processed in 34us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652442.761653:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788652442.761675:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627811968 00000100:00100000:0.0:1788652442.761678:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627811968 00000100:00100000:0.0:1788652442.761696:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627811840 00000100:00080000:3.0:1788652442.761985:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788652442.761990:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788652442.761998:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788652442.762114:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788652442.762124:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875537627811968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652442.762164:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875537627811968:12345-0@lo:400:kworker.0 Request processed in 43us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652442.762170:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788652442.762257:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627811840 00000100:00100000:0.0:1788652442.762325:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788652442.762333:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875537627811840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652442.762365:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875537627811840:12345-0@lo:400:kworker.0 Request processed in 34us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652442.762371:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788652442.762403:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875537627811840:0@lo:400:kworker.0 00000100:00100000:0.0:1788652442.762412:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a384a7b-92b2-4f9e-a496-63aebbb65331:3306:1875537627811456:0@lo:400:kworker.0 00000100:00100000:0.0:1788652442.762422:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875537627811968:0@lo:400:kworker.0 00000100:00100000:1.0:1788652442.763575:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627812096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788652442.763633:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652442.763722:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627812096 00000100:00100000:0.0:1788652442.763728:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627812096 00000100:00100000:0.0:1788652442.763793:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788652442.763802:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627812096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788652442.763832:0:14992:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788652442.763875:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627812096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652442.763881:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788652442.763918:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627812096:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788652442.769018:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788652442.866745:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652442.866978:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603704448 00000100:00100000:2.0:1788652442.866989:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603704448 00000100:00100000:2.0:1788652442.867048:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 105 00000100:00100000:2.0:1788652442.867058:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81530050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+11:13736:x1875537603704448:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788652442.867074:0:14299:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652442.867093:0:14299:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe75dd0e00/0x340ed74ef02a8986 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0cf0 expref: -99 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652442.867121:0:14299:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe75dd0e00/0x340ed74ef02a8986 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0cf0 expref: 12 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652442.867133:0:14299:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe75dd0e00/0x340ed74ef02a8986 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0cf0 expref: 12 pid: 14299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652442.867142:0:14299:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe75dd0e00, rc 0) 00000100:00100000:2.0:1788652442.868064:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81530050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+12:13736:x1875537603704448:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 Request processed in 1005us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652442.868072:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 105 00000100:00100000:3.0:1788652442.873616:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652442.873691:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603704576 00000100:00100000:1.0:1788652442.873710:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603704576 00000100:00100000:0.0:1788652442.873805:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 106 00000100:00100000:0.0:1788652442.873818:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe81531850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd83be1f-82a0-4980-8afc-69f413012e95+12:13736:x1875537603704576:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788652442.874082:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe81531850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd83be1f-82a0-4980-8afc-69f413012e95+12:13736:x1875537603704576:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 Request processed in 268us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652442.874088:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 106 00000100:00100000:3.0:1788652442.877632:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652442.877807:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603704704 00000100:00100000:2.0:1788652442.877818:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603704704 00000100:00100000:2.0:1788652442.877876:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 107 00000100:00100000:2.0:1788652442.877886:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+12:13736:x1875537603704704:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788652442.878105:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+12:13736:x1875537603704704:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 Request processed in 219us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652442.878113:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 107 00000100:00100000:0.0:1788652442.891981:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652442.892054:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603704832 00000100:00100000:3.0:1788652442.892064:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603704832 00000100:00100000:3.0:1788652442.892117:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 108 00000100:00100000:3.0:1788652442.892127:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd83be1f-82a0-4980-8afc-69f413012e95+12:13736:x1875537603704832:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652442.892143:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652442.892160:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7a0e4e00/0x340ed74ef02a898d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0cf7 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652442.892187:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7a0e4e00/0x340ed74ef02a898d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0cf7 expref: 13 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652442.892198:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7a0e4e00/0x340ed74ef02a898d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0cf7 expref: 13 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652442.892207:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e4e00, rc 0) 00000100:00100000:3.0:1788652442.892261:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd83be1f-82a0-4980-8afc-69f413012e95+13:13736:x1875537603704832:12345-192.168.203.50@tcp:101:ll_cfg_requeue.0 Request processed in 135us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652442.892267:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 108 00000100:00100000:3.0:1788652442.895083:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652442.895432:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603704960 00000100:00100000:1.0:1788652442.895442:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603704960 00000100:00100000:1.0:1788652442.895676:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 109 00000100:00100000:1.0:1788652442.895688:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd83be1f-82a0-4980-8afc-69f413012e95+13:13736:x1875537603704960:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788652442.896200:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd83be1f-82a0-4980-8afc-69f413012e95+13:13736:x1875537603704960:12345-192.168.203.50@tcp:501:ll_cfg_requeue.0 Request processed in 513us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652442.896209:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 109 00000100:00100000:3.0:1788652442.900062:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652442.900139:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603705088 00000100:00100000:2.0:1788652442.900155:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603705088 00000100:00100000:2.0:1788652442.900208:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 110 00000100:00100000:2.0:1788652442.900218:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+13:13736:x1875537603705088:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788652442.900434:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+13:13736:x1875537603705088:12345-192.168.203.50@tcp:503:ll_cfg_requeue.0 Request processed in 217us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652442.900442:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 110 00010000:00010000:0.0:1788652442.955966:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788652443.335943:0:14301:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788652443.335951:0:14301:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe81a27800 from 10 10000000:01000000:2.0:1788652443.335956:0:14301:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788652443.336000:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe75dd0c00/0x340ed74ef02a8994 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652443.336013:0:14301:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe75dd0c00/0x340ed74ef02a8994 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652443.336024:0:14301:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe75dd0c00/0x340ed74ef02a8994 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652443.336050:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627812224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788652443.336112:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652443.336223:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe50552600 going to sleep for 11 seconds 00000100:00100000:1.0:1788652443.336280:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627812224 00000100:00100000:1.0:1788652443.336287:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627812224 00000100:00100000:1.0:1788652443.336333:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788652443.336350:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+16:14301:x1875537627812224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788652443.336361:0:14297:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652443.336374:0:14297:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7a0c9a00/0x340ed74ef02a899b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a8994 expref: -99 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652443.336396:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7a0c9a00/0x340ed74ef02a899b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a8994 expref: 17 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652443.336406:0:14297:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7a0c9a00/0x340ed74ef02a899b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a8994 expref: 17 pid: 14297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652443.336416:0:14297:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c9a00, rc 0) 00000100:00100000:1.0:1788652443.336465:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+17:14301:x1875537627812224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652443.336521:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627812224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652443.336545:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe75dd0c00/0x340ed74ef02a8994 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a899b expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652443.336556:0:14301:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe75dd0c00/0x340ed74ef02a8994 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a899b expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652443.336605:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788652443.336622:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627812352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788652443.336659:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652443.336684:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb180 going to sleep for 11 seconds 00000100:00100000:2.0:1788652443.336710:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627812352 00000100:00100000:2.0:1788652443.336715:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627812352 00000100:00100000:2.0:1788652443.336747:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788652443.336754:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+17:14301:x1875537627812352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788652443.337884:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+17:14301:x1875537627812352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1126us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652443.337895:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788652443.338986:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627812352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788652443.339125:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f82f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627812480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788652443.339216:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652443.339256:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe48f53840 going to sleep for 11 seconds 00000100:00100000:0.0:1788652443.339318:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627812480 00000100:00100000:0.0:1788652443.339324:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627812480 00000100:00100000:0.0:1788652443.339372:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788652443.339381:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+17:14301:x1875537627812480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788652443.340207:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a384a7b-92b2-4f9e-a496-63aebbb65331+17:14301:x1875537627812480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 825us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652443.340216:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788652443.340914:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f82f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627812480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788652443.341872:0:16494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788652443.342088:0:14301:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788652443.342117:0:14301:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788652443.342130:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe75dd0c00/0x340ed74ef02a8994 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a899b expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652443.342155:0:14301:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe75dd0c00/0x340ed74ef02a8994 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a899b expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652443.342167:0:14301:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788652443.342169:0:14301:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe43929800 from 10 10000000:01000000:2.0:1788652443.342172:0:14301:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788652443.342211:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe75dd0600/0x340ed74ef02a89a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652443.342219:0:14301:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe75dd0600/0x340ed74ef02a89a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652443.342231:0:14301:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe75dd0600/0x340ed74ef02a89a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652443.342256:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627812608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788652443.342319:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652443.342366:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe50552a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788652443.342620:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627812608 00000100:00100000:1.0:1788652443.342628:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627812608 00000100:00100000:1.0:1788652443.342685:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788652443.342696:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+17:14301:x1875537627812608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788652443.342711:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652443.342727:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7a0c9400/0x340ed74ef02a89a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a89a2 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652443.343203:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7a0c9400/0x340ed74ef02a89a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a89a2 expref: 18 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652443.343217:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7a0c9400/0x340ed74ef02a89a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a89a2 expref: 18 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652443.343227:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c9400, rc 0) 00000100:00100000:1.0:1788652443.343282:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+18:14301:x1875537627812608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 587us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652443.343289:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788652443.343342:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627812608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788652443.343359:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe75dd0600/0x340ed74ef02a89a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a89a9 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652443.343370:0:14301:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe75dd0600/0x340ed74ef02a89a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a89a9 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652443.343441:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f82f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627812736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788652443.343470:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652443.343490:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4943c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652443.343549:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627812736 00000100:00100000:2.0:1788652443.343554:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627812736 00000100:00100000:2.0:1788652443.343594:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788652443.343602:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+18:14301:x1875537627812736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788652443.343940:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+18:14301:x1875537627812736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 337us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652443.343948:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788652443.344338:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f82f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627812736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788652443.344375:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f82f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627812864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788652443.344414:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652443.344476:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4943c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652443.344503:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627812864 00000100:00100000:2.0:1788652443.344507:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627812864 00000100:00100000:2.0:1788652443.344560:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788652443.344567:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+18:14301:x1875537627812864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788652443.344725:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+18:14301:x1875537627812864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652443.344734:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788652443.344829:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f82f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627812864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788652443.347574:0:16495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788652443.348438:0:14301:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788652443.348470:0:14301:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788652443.348483:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe75dd0600/0x340ed74ef02a89a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a89a9 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652443.348497:0:14301:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe75dd0600/0x340ed74ef02a89a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a89a9 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652443.348508:0:14301:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788652443.348511:0:14301:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cbe48680800 from 10 10000000:01000000:0.0:1788652443.348513:0:14301:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788652443.348552:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe75f1a600/0x340ed74ef02a89b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652443.348561:0:14301:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.150@tcp lock: ffff8cbe75f1a600/0x340ed74ef02a89b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652443.348572:0:14301:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.150@tcp lock: ffff8cbe75f1a600/0x340ed74ef02a89b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652443.348623:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627812992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788652443.348688:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652443.349975:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652443.350128:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627812992 00000100:00100000:1.0:1788652443.350137:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627812992 00000100:00100000:1.0:1788652443.350241:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788652443.350255:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+18:14301:x1875537627812992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788652443.350271:0:14298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652443.350290:0:14298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cbe7a0c9800/0x340ed74ef02a89b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x340ed74ef02a89b0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652443.350320:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cbe7a0c9800/0x340ed74ef02a89b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x340ed74ef02a89b0 expref: 19 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652443.350333:0:14298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cbe7a0c9800/0x340ed74ef02a89b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x340ed74ef02a89b0 expref: 19 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652443.350343:0:14298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c9800, rc 0) 00000100:00100000:1.0:1788652443.350414:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:14301:x1875537627812992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652443.350423:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788652443.350692:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627812992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652443.350711:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.150@tcp lock: ffff8cbe75f1a600/0x340ed74ef02a89b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a89b7 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652443.350721:0:14301:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.150@tcp lock: ffff8cbe75f1a600/0x340ed74ef02a89b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x340ed74ef02a89b7 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652443.350813:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627813120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788652443.350841:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652443.350863:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652443.351084:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627813120 00000100:00100000:2.0:1788652443.351089:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627813120 00000100:00100000:2.0:1788652443.351114:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788652443.351121:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:14301:x1875537627813120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788652443.351338:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:14301:x1875537627813120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 217us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652443.351345:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788652443.352500:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627813120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652443.352548:0:14301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbd41faa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627813248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788652443.352612:0:14301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652443.352656:0:14301:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4b7bac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788652443.352675:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627813248 00000100:00100000:3.0:1788652443.352680:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627813248 00000100:00100000:3.0:1788652443.352717:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788652443.352727:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7595cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:14301:x1875537627813248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788652443.352954:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7595cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:14301:x1875537627813248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652443.352961:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788652443.353009:0:14301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbd41faa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a384a7b-92b2-4f9e-a496-63aebbb65331:14301:1875537627813248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788652443.353706:0:16496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788652443.353761:0:14301:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788652443.353795:0:14301:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.150@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788652443.353805:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.150@tcp lock: ffff8cbe75f1a600/0x340ed74ef02a89b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a89b7 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652443.353817:0:14301:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.150@tcp lock: ffff8cbe75f1a600/0x340ed74ef02a89b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x340ed74ef02a89b7 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652443.975933:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788652444.360519:0:14338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788652445.000648:0:15837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652445.192155:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652445.192350:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603705216 00000100:00100000:1.0:1788652445.192361:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603705216 00000100:00100000:1.0:1788652445.192425:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00100000:1.0:1788652445.192435:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41faa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+6:14391:x1875537603705216:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788652445.192454:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652445.192502:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8600/0x340ed74ef02a89be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0cfe expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.192577:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a89c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.192604:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a89c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788652445.192671:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788652445.192729:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a89c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.192747:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a89cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.192755:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a89cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.192874:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a89cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.193461:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a89d3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.193473:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a89d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.193482:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a89d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652445.193509:0:14305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788652445.193513:0:14305:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788652445.193551:0:14305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a89d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.193562:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a89c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.193590:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a89c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.193596:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a89c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.193602:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652445.193606:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a89c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.193614:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a89c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.193627:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe7fde3f00) 00010000:00010000:1.0:1788652445.193630:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652445.193635:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a89c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.193641:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9200/0x340ed74ef02a89c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.193653:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a89cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.193658:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a89cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.193663:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a89cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.193668:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c8e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652445.193676:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a89cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.193683:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a89cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.193691:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8cbe48da0600) 00010000:00010000:1.0:1788652445.193693:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652445.193696:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a89cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.193702:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8e00/0x340ed74ef02a89cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.193738:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8600/0x340ed74ef02a89be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0cfe expref: 8 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.193751:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c8200/0x340ed74ef02a89d3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0cfe expref: 7 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.193758:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cbe48da0200) 00010000:00010000:1.0:1788652445.193760:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788652445.194270:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0c8200, rc 0) 00000100:00100000:1.0:1788652445.194340:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41faa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+7:14391:x1875537603705216:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 1906us (2194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652445.194349:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00100000:3.0:1788652445.197879:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652445.199836:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603705472 00000100:00100000:1.0:1788652445.199850:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603705472 00000100:00100000:1.0:1788652445.199999:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:1.0:1788652445.200011:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+7:14391:x1875537603705472:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788652445.200045:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652445.200065:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9c00/0x340ed74ef02a89da lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0d05 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.200151:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a89e1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.200166:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a89e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.200176:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a89e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.200224:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a89e8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.200232:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a89e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.200239:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a89e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.200743:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10800/0x340ed74ef02a89ef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.200753:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10800/0x340ed74ef02a89ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.200761:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10800/0x340ed74ef02a89ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652445.200796:0:14304:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788652445.200995:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a89e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.201004:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a89e1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.201010:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a89e1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.201016:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652445.201021:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a89e1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.201029:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a89e1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.201041:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cbe48da0200) 00010000:00010000:1.0:1788652445.201044:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652445.201049:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a89e1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.201055:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9000/0x340ed74ef02a89e1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.201068:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a89e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.201074:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a89e8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.201079:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a89e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.201094:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0c9600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652445.201097:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a89e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.201103:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a89e8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.201110:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cbe48da0000) 00010000:00010000:1.0:1788652445.201113:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652445.201115:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a89e8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.201120:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9600/0x340ed74ef02a89e8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.202036:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0c9c00/0x340ed74ef02a89da lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d05 expref: 10 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.202055:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10800/0x340ed74ef02a89ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d05 expref: 9 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.202062:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbe48da0c00) 00010000:00010000:1.0:1788652445.202065:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652445.202068:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7fd10800, rc 0) 00000100:00100000:1.0:1788652445.202149:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+9:14391:x1875537603705472:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 2141us (4280us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788652445.202158:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 16 00000100:00100000:3.0:1788652445.222986:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652445.223075:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603705600 00000100:00100000:0.0:1788652445.223087:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603705600 00000100:00100000:0.0:1788652445.223219:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:0.0:1788652445.223229:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c66a6a95-dcf9-4296-ba30-508b18ee8b72+9:14391:x1875537603705600:12345-192.168.203.50@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788652445.223346:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c66a6a95-dcf9-4296-ba30-508b18ee8b72+9:14391:x1875537603705600:12345-192.168.203.50@tcp:59:lhsmtool_posix.0 Request processed in 111us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652445.223354:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 17 00000100:00100000:3.0:1788652445.262824:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652445.263617:0:15716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603705728 00000100:00100000:2.0:1788652445.263632:0:15716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603705728 00000100:00100000:2.0:1788652445.263701:0:15716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:2.0:1788652445.263711:0:15716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41faad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+9:14397:x1875537603705728:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1788652445.263732:0:15716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652445.263757:0:15716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a89fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0d0c expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.263866:0:15716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8a04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.263884:0:15716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8a04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.263924:0:15716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8a04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.263940:0:15716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0200/0x340ed74ef02a8a0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.263948:0:15716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0200/0x340ed74ef02a8a0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.263955:0:15716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0200/0x340ed74ef02a8a0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.264155:0:15716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8a04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.264164:0:15716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8a04 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.264171:0:15716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8a04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.264177:0:15716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75dd1600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652445.264182:0:15716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8a04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.264190:0:15716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8a04 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.264202:0:15716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe7fde3f00) 00010000:00010000:2.0:1788652445.264206:0:15716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652445.264210:0:15716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8a04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.264223:0:15716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8a04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.264236:0:15716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0200/0x340ed74ef02a8a0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.264242:0:15716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0200/0x340ed74ef02a8a0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.264248:0:15716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0200/0x340ed74ef02a8a0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.264253:0:15716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75dd0200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652445.264256:0:15716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0200/0x340ed74ef02a8a0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.264262:0:15716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0200/0x340ed74ef02a8a0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.264271:0:15716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cbe485ac100) 00010000:00010000:2.0:1788652445.264274:0:15716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652445.264276:0:15716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0200/0x340ed74ef02a8a0b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.264282:0:15716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0200/0x340ed74ef02a8a0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.264317:0:15716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a89fd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d0c expref: 10 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.264351:0:15716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe7fde3f00) 00010000:00010000:2.0:1788652445.264353:0:15716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652445.264358:0:15716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a89fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d0c expref: 10 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.264369:0:15716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe75dd0800, rc 0) 00000100:00100000:2.0:1788652445.264435:0:15716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41faad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+9:14397:x1875537603705728:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 725us (1620us total) trans 0 rc 301/301 00000100:00100000:2.0:1788652445.264442:0:15716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 18 00000100:00100000:3.0:1788652445.277905:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652445.278031:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603705856 00000100:00100000:1.0:1788652445.278052:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603705856 00000100:00100000:1.0:1788652445.278108:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:1.0:1788652445.278127:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+9:14397:x1875537603705856:12345-192.168.203.50@tcp:700:lfs.0 00000100:00100000:1.0:1788652445.278216:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+9:14397:x1875537603705856:12345-192.168.203.50@tcp:700:lfs.0 Request processed in 99us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652445.278224:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:3.0:1788652445.279874:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652445.279972:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603706112 00000100:00100000:0.0:1788652445.279981:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603706112 00000100:00100000:0.0:1788652445.280034:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 19 00000100:00100000:0.0:1788652445.280042:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c66a6a95-dcf9-4296-ba30-508b18ee8b72+9:14397:x1875537603706112:12345-192.168.203.50@tcp:36:lfs.0 00010000:00010000:0.0:1788652445.280092:0:14306:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652445.280139:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a8940 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0c87 expref: 9 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.280157:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe7fde3f00) 00010000:00010000:0.0:1788652445.280163:0:14306:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788652445.280375:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a12 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.280390:0:14306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1aa00/0x340ed74ef02a8978 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ce9 expref: 5 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.280399:0:14306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a12 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.280430:0:14306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1aa00/0x340ed74ef02a8978 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ce9 expref: 5 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.280443:0:14306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1aa00/0x340ed74ef02a8978 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ce9 expref: 5 pid: 14306 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652445.280458:0:14306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14306:1875537627813376:192.168.203.50@tcp:104: 00000100:00100000:0.0:1788652445.280900:0:14306:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652445.285756:0:14306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14306:1875537627813376:192.168.203.50@tcp:104: 00010000:00010000:1.0:1788652445.285828:0:14306:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a12 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652445.286882:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652445.289710:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603706240 00000100:00100000:1.0:1788652445.289731:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603706240 00010000:00010000:1.0:1788652445.289942:0:14289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1aa00/0x340ed74ef02a8978 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ce9 expref: 6 pid: 14306 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652445.289987:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:1.0:1788652445.289997:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fbfa306-1be4-498a-9298-3679b70726ba+6:2346:x1875537603706240:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652445.290016:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652445.290025:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1aa00/0x340ed74ef02a8978 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ce9 expref: 6 pid: 14306 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.290041:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1aa00/0x340ed74ef02a8978 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ce9 expref: 6 pid: 14306 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.290069:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1aa00/0x340ed74ef02a8978 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0ce9 expref: 6 pid: 14306 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.290114:0:14289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe7fde3f00) 00010000:00010000:1.0:1788652445.290120:0:14289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a12 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.290144:0:14289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a12 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.290153:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a12 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.290198:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652445.290279:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fbfa306-1be4-498a-9298-3679b70726ba+5:2346:x1875537603706240:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 283us (3409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652445.290287:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00080000:3.0:1788652445.291477:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788652445.292090:0:14306:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a12 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.292109:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a12 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.292147:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b400/0x340ed74ef02a8a19 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.292180:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b400/0x340ed74ef02a8a19 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.292192:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b400/0x340ed74ef02a8a19 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652445.293547:0:14306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788652445.293562:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a12 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.293584:0:14306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a12 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.293591:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a12 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.293596:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75f1a200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652445.293600:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a12 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.293607:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a12 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.293622:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe7fde3f00) 00010000:00010000:0.0:1788652445.293625:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652445.293630:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a12 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.293635:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a12 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788652445.293670:0:14306:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002eb4511e reply state 00000000d9fecabf transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b400/0x340ed74ef02a8a19 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652445.293679:0:14306:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788652445.293809:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c66a6a95-dcf9-4296-ba30-508b18ee8b72+10:14397:x1875537603706112:12345-192.168.203.50@tcp:36:lfs.0 Request processed in 13763us (13938us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788652445.293818:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 19 00010000:00010000:0.0:1788652445.299689:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b400/0x340ed74ef02a8a19 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.299707:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b400/0x340ed74ef02a8a19 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.299714:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b400/0x340ed74ef02a8a19 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.299721:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75f1b400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652445.299725:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b400/0x340ed74ef02a8a19 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.299733:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b400/0x340ed74ef02a8a19 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.299751:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cbe4b956b00) 00010000:00010000:0.0:1788652445.299753:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652445.299758:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b400/0x340ed74ef02a8a19 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.299764:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b400/0x340ed74ef02a8a19 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788652445.384560:0:14338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788652445.391657:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652445.392194:0:15716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603706368 00000100:00100000:2.0:1788652445.392210:0:15716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603706368 00000100:00100000:2.0:1788652445.392291:0:15716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00100000:2.0:1788652445.392303:0:15716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+9:14405:x1875537603706368:12345-192.168.203.50@tcp:101:lctl.0 00010000:00010000:2.0:1788652445.392334:0:15716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652445.392367:0:15716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a8a20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0d13 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.392450:0:15716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0200/0x340ed74ef02a8a27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.392468:0:15716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0200/0x340ed74ef02a8a27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.392482:0:15716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0200/0x340ed74ef02a8a27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652445.392672:0:15716:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788652445.392677:0:15716:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788652445.392726:0:15716:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0200/0x340ed74ef02a8a27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.392756:0:15716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a8a20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d13 expref: 11 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.392828:0:15716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0200/0x340ed74ef02a8a27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d13 expref: 10 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.392838:0:15716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe485ac100) 00010000:00010000:2.0:1788652445.392841:0:15716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788652445.392846:0:15716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe75dd0200, rc 0) 00000100:00100000:2.0:1788652445.392926:0:15716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+10:14405:x1875537603706368:12345-192.168.203.50@tcp:101:lctl.0 Request processed in 625us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652445.392933:0:15716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 20 00000100:00100000:3.0:1788652445.430437:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652445.431252:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603706496 00000100:00100000:1.0:1788652445.431272:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603706496 00000100:00100000:1.0:1788652445.431356:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:1.0:1788652445.431368:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fbfa306-1be4-498a-9298-3679b70726ba+5:14406:x1875537603706496:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1788652445.431396:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652445.431423:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10000/0x340ed74ef02a8a2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0d1a expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.431506:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10400/0x340ed74ef02a8a35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.431523:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10400/0x340ed74ef02a8a35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.431686:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10400/0x340ed74ef02a8a35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652445.431736:0:14305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788652445.431741:0:14305:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788652445.431876:0:14305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10400/0x340ed74ef02a8a35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.431910:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10000/0x340ed74ef02a8a2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d1a expref: 7 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.431932:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10400/0x340ed74ef02a8a35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d1a expref: 6 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.431941:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe485ac100) 00010000:00010000:1.0:1788652445.431944:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788652445.431949:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7fd10400, rc 0) 00000100:00100000:2.0:1788652445.433316:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8fbfa306-1be4-498a-9298-3679b70726ba+6:14406:x1875537603706496:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 1935us (2880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652445.433329:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 21 00000100:00100000:3.0:1788652445.440894:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652445.441236:0:15716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603706624 00000100:00100000:2.0:1788652445.441250:0:15716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603706624 00000100:00100000:2.0:1788652445.441337:0:15716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 22 00000100:00100000:2.0:1788652445.441349:0:15716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fbfa306-1be4-498a-9298-3679b70726ba+6:14406:x1875537603706624:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:2.0:1788652445.441376:0:15716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652445.441403:0:15716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a8a3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0d21 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.441508:0:15716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8a43 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.441526:0:15716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8a43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.441541:0:15716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8a43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.441582:0:15716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0400/0x340ed74ef02a8a4a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.441591:0:15716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0400/0x340ed74ef02a8a4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.441599:0:15716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0400/0x340ed74ef02a8a4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.441713:0:15716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0a00/0x340ed74ef02a8a51 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.441722:0:15716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0a00/0x340ed74ef02a8a51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.441729:0:15716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0a00/0x340ed74ef02a8a51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652445.441766:0:15716:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788652445.441817:0:15716:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788652445.441843:0:15716:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0a00/0x340ed74ef02a8a51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.441868:0:15716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8a43 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.441876:0:15716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8a43 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.441885:0:15716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8a43 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.441891:0:15716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75dd1600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652445.441896:0:15716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8a43 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.441905:0:15716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8a43 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.441920:0:15716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe485ac100) 00010000:00010000:2.0:1788652445.441923:0:15716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652445.441928:0:15716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8a43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.441936:0:15716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8a43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.441951:0:15716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0400/0x340ed74ef02a8a4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.441958:0:15716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0400/0x340ed74ef02a8a4a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.441964:0:15716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0400/0x340ed74ef02a8a4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.441989:0:15716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75dd0400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652445.441993:0:15716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0400/0x340ed74ef02a8a4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.441999:0:15716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0400/0x340ed74ef02a8a4a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.442008:0:15716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cbe485acf00) 00010000:00010000:2.0:1788652445.442011:0:15716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652445.442013:0:15716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0400/0x340ed74ef02a8a4a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.442020:0:15716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0400/0x340ed74ef02a8a4a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.442062:0:15716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a8a3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d21 expref: 8 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.442077:0:15716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0a00/0x340ed74ef02a8a51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d21 expref: 7 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.442085:0:15716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cbe485ac000) 00010000:00010000:2.0:1788652445.442088:0:15716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788652445.442090:0:15716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe75dd0a00, rc 0) 00000100:00100000:2.0:1788652445.442181:0:15716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fbfa306-1be4-498a-9298-3679b70726ba+7:14406:x1875537603706624:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 834us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652445.442189:0:15716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 22 00000100:00100000:1.0:1788652445.449651:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652445.449818:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603706880 00000100:00100000:0.0:1788652445.449833:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603706880 00000100:00100000:0.0:1788652445.449909:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:0.0:1788652445.449922:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fbfa306-1be4-498a-9298-3679b70726ba+7:14406:x1875537603706880:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1788652445.449952:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652445.449986:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b400/0x340ed74ef02a8a58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0d28 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652445.450111:0:14306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788652445.450286:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b400/0x340ed74ef02a8a58 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d28 expref: 9 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.450304:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe485ac100) 00010000:00010000:0.0:1788652445.450308:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788652445.450314:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b400/0x340ed74ef02a8a58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d28 expref: 9 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.450619:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe75f1b400, rc 0) 00000100:00100000:0.0:1788652445.450713:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fbfa306-1be4-498a-9298-3679b70726ba+8:14406:x1875537603706880:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 793us (1077us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788652445.450723:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 23 00000100:00100000:3.0:1788652445.453351:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652445.454385:0:15716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603707136 00000100:00100000:2.0:1788652445.454423:0:15716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603707136 00000100:00100000:2.0:1788652445.454498:0:15716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 24 00000100:00100000:2.0:1788652445.454509:0:15716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fbfa306-1be4-498a-9298-3679b70726ba+8:14406:x1875537603707136:12345-192.168.203.50@tcp:36:lfs.0 00010000:00010000:2.0:1788652445.454919:0:15716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652445.454954:0:15716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0a00/0x340ed74ef02a8a51 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d21 expref: 8 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.454985:0:15716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cbe485ac000) 00010000:00010000:2.0:1788652445.455000:0:15716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788652445.455029:0:15716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1200/0x340ed74ef02a8a66 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.455045:0:15716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1200/0x340ed74ef02a8a66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.455056:0:15716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1200/0x340ed74ef02a8a66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788652445.456103:0:15716:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aed4a1cb reply state 00000000ca6bf0bc transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1200/0x340ed74ef02a8a66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652445.456619:0:15716:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788652445.456636:0:15716:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788652445.457575:0:15716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8fbfa306-1be4-498a-9298-3679b70726ba+9:14406:x1875537603707136:12345-192.168.203.50@tcp:36:lfs.0 Request processed in 3048us (4218us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788652445.457591:0:15716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 24 00010000:00010000:0.0:1788652445.462610:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1200/0x340ed74ef02a8a66 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.462634:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1200/0x340ed74ef02a8a66 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.462680:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1200/0x340ed74ef02a8a66 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.462687:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75dd1200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652445.462693:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1200/0x340ed74ef02a8a66 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.462704:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1200/0x340ed74ef02a8a66 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.462724:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cbe485ac200) 00010000:00010000:0.0:1788652445.462739:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788652445.462745:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1200/0x340ed74ef02a8a66 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.462752:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1200/0x340ed74ef02a8a66 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652445.465044:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652445.469275:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603707392 00000100:00100000:2.0:1788652445.469298:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603707392 00000100:00100000:3.0:1788652445.470643:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:3.0:1788652445.470660:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8fbfa306-1be4-498a-9298-3679b70726ba+8:14406:x1875537603707392:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:3.0:1788652445.471436:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8fbfa306-1be4-498a-9298-3679b70726ba+9:14406:x1875537603707392:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 775us (6402us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788652445.471446:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:0.0:1788652445.475924:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652445.476028:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603707648 00000100:00100000:1.0:1788652445.476042:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603707648 00000100:00100000:1.0:1788652445.476218:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 25 00000100:00100000:1.0:1788652445.476232:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fbfa306-1be4-498a-9298-3679b70726ba+9:14406:x1875537603707648:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:1.0:1788652445.476266:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652445.476295:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10a00/0x340ed74ef02a8a6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0d2f expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.476466:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11400/0x340ed74ef02a8a74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.476505:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11400/0x340ed74ef02a8a74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.476519:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11400/0x340ed74ef02a8a74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.476538:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10e00/0x340ed74ef02a8a7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.476626:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10e00/0x340ed74ef02a8a7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.476635:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10e00/0x340ed74ef02a8a7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652445.477225:0:14306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788652445.477425:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11400/0x340ed74ef02a8a74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.477436:0:14306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11400/0x340ed74ef02a8a74 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.477445:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11400/0x340ed74ef02a8a74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.477451:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7fd11400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652445.477457:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11400/0x340ed74ef02a8a74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.477477:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11400/0x340ed74ef02a8a74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.477493:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe485ac100) 00010000:00010000:0.0:1788652445.477496:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652445.477502:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11400/0x340ed74ef02a8a74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.477510:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11400/0x340ed74ef02a8a74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.477528:0:14306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10e00/0x340ed74ef02a8a7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.477535:0:14306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10e00/0x340ed74ef02a8a7b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.477615:0:14306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10e00/0x340ed74ef02a8a7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.477621:0:14306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7fd10e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652445.477625:0:14306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10e00/0x340ed74ef02a8a7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.477631:0:14306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10e00/0x340ed74ef02a8a7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.477639:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cbe48da0000) 00010000:00010000:0.0:1788652445.477642:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652445.477645:0:14306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10e00/0x340ed74ef02a8a7b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.477725:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10e00/0x340ed74ef02a8a7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.477922:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10a00/0x340ed74ef02a8a6d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d2f expref: 11 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.477935:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe485ac100) 00010000:00010000:0.0:1788652445.477938:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788652445.477942:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10a00/0x340ed74ef02a8a6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d2f expref: 11 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.477952:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7fd10a00, rc 0) 00000100:00100000:0.0:1788652445.478097:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8fbfa306-1be4-498a-9298-3679b70726ba+10:14406:x1875537603707648:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 1867us (2187us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788652445.478107:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 25 00000100:00100000:3.0:1788652445.482371:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652445.482636:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603707776 00000100:00100000:0.0:1788652445.482650:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603707776 00000100:00100000:0.0:1788652445.482750:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 26 00000100:00100000:0.0:1788652445.482762:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fbfa306-1be4-498a-9298-3679b70726ba+10:14406:x1875537603707776:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1788652445.482818:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652445.482849:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b400/0x340ed74ef02a8a89 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0d36 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.482959:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a90 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.482976:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.483012:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652445.483048:0:14304:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788652445.483052:0:14304:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788652445.483073:0:14304:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.483102:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b400/0x340ed74ef02a8a89 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d36 expref: 12 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.483503:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a90 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d36 expref: 11 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.483514:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cbe4b956b00) 00010000:00010000:0.0:1788652445.483517:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788652445.483521:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe75f1a200, rc 0) 00000100:00100000:0.0:1788652445.483745:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8fbfa306-1be4-498a-9298-3679b70726ba+11:14406:x1875537603707776:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 984us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652445.483754:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 26 00000100:00100000:1.0:1788652445.488639:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652445.489401:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603707904 00000100:00100000:2.0:1788652445.489419:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603707904 00000100:00100000:2.0:1788652445.489558:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:2.0:1788652445.489580:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8fbfa306-1be4-498a-9298-3679b70726ba+11:14406:x1875537603707904:12345-192.168.203.50@tcp:37:lfs.0 00000100:00100000:2.0:1788652445.495290:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8fbfa306-1be4-498a-9298-3679b70726ba+11:14406:x1875537603707904:12345-192.168.203.50@tcp:37:lfs.0 Request processed in 5698us (6651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652445.495310:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:1.0:1788652445.500994:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652445.501108:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603708160 00000100:00100000:3.0:1788652445.501186:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603708160 00000100:00100000:3.0:1788652445.501327:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:3.0:1788652445.501340:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f137c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8fbfa306-1be4-498a-9298-3679b70726ba+11:14406:x1875537603708160:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:3.0:1788652445.501832:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f137c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8fbfa306-1be4-498a-9298-3679b70726ba+12:14406:x1875537603708160:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 492us (852us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788652445.501842:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:1.0:1788652445.566187:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652445.566353:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603708288 00000100:00100000:3.0:1788652445.566366:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603708288 00000100:00100000:3.0:1788652445.566456:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 27 00000100:00100000:3.0:1788652445.566467:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+10:14412:x1875537603708288:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:3.0:1788652445.566493:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652445.566521:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5e00/0x340ed74ef02a8a97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0d3d expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.566614:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a8a9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.566633:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a8a9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.566650:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a8a9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.566677:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a8aa5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.566685:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a8aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.566693:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a8aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.566861:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a8aac lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.566870:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a8aac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.566878:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a8aac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652445.566919:0:14305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788652445.566922:0:14305:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788652445.566964:0:14305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a8aac lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.566978:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a8a9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.566985:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a8a9e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.566993:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a8a9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.566999:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652445.567004:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a8a9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.567012:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a8a9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.567025:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe485ac100) 00010000:00010000:3.0:1788652445.567028:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652445.567033:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a8a9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.567039:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5000/0x340ed74ef02a8a9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.567053:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a8aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.567067:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a8aa5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.567073:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a8aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.567078:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652445.567081:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a8aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.567087:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a8aa5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.567093:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cbe7fde3900) 00010000:00010000:3.0:1788652445.567095:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652445.567098:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a8aa5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.567103:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a8aa5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.567147:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5e00/0x340ed74ef02a8a97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d3d expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.567160:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5200/0x340ed74ef02a8aac lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d3d expref: 11 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.567168:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cbe4b956b00) 00010000:00010000:3.0:1788652445.567170:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788652445.567178:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5200, rc 0) 00000100:00100000:3.0:1788652445.567244:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+11:14412:x1875537603708288:12345-192.168.203.50@tcp:101:bash.0 Request processed in 778us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652445.567252:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 27 00000100:00100000:0.0:1788652445.570941:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652445.571242:0:15716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603708544 00000100:00100000:2.0:1788652445.571256:0:15716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603708544 00000100:00100000:2.0:1788652445.571430:0:15716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 28 00000100:00100000:2.0:1788652445.571444:0:15716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+11:14412:x1875537603708544:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:2.0:1788652445.571473:0:15716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652445.574920:0:15716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0a00/0x340ed74ef02a8ab3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0d44 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.575129:0:15716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a8aba lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.575153:0:15716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a90 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d36 expref: 11 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.575164:0:15716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a8aba lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.575214:0:15716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a90 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d36 expref: 11 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.575235:0:15716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a90 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d36 expref: 11 pid: 14304 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652445.575255:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15716:1875537627813504:192.168.203.50@tcp:104: 00000100:00100000:2.0:1788652445.575393:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4a5d76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652445.579589:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652445.579979:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603708672 00000100:00100000:1.0:1788652445.579994:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603708672 00010000:00010000:1.0:1788652445.580054:0:14290:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a90 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d36 expref: 12 pid: 14304 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652445.580105:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:1.0:1788652445.580117:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fbfa306-1be4-498a-9298-3679b70726ba+12:2347:x1875537603708672:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652445.580147:0:14290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652445.580155:0:14290:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a90 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d36 expref: 12 pid: 14304 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.580194:0:14290:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a90 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d36 expref: 12 pid: 14304 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.580225:0:14290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cbe4b956b00) 00010000:00010000:1.0:1788652445.580231:0:14290:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a8aba lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.580242:0:14290:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a8aba lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.580251:0:14290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a8aba lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.580277:0:14290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652445.580352:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fbfa306-1be4-498a-9298-3679b70726ba+12:2347:x1875537603708672:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 236us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652445.580361:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 10 00010000:00010000:2.0:1788652445.582072:0:15716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8a90 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d36 expref: 11 pid: 14304 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652445.582102:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15716:1875537627813504:192.168.203.50@tcp:104: 00010000:00010000:2.0:1788652445.582144:0:15716:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a8aba lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.582174:0:15716:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a8aba lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.582181:0:15716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a8aba lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.582214:0:15716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0400/0x340ed74ef02a8ac1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.582229:0:15716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0400/0x340ed74ef02a8ac1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.582241:0:15716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0400/0x340ed74ef02a8ac1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.583619:0:15716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8ac8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.583639:0:15716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.583650:0:15716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652445.584264:0:15716:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788652445.585913:0:15716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a8aba lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.585936:0:15716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a8aba lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.585944:0:15716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a8aba lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.585972:0:15716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75dd0800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652445.585978:0:15716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a8aba lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.586059:0:15716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a8aba lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.586586:0:15716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cbe4b956b00) 00010000:00010000:2.0:1788652445.586592:0:15716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652445.586601:0:15716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a8aba lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.586609:0:15716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a8aba lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788652445.586646:0:15716:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5dda24d reply state 00000000f024de0e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0400/0x340ed74ef02a8ac1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652445.586659:0:15716:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788652445.586742:0:15716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0a00/0x340ed74ef02a8ab3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d44 expref: 14 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.586762:0:15716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d44 expref: 13 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.587379:0:15716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbe485acf00) 00010000:00010000:2.0:1788652445.587385:0:15716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788652445.587388:0:15716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe75dd1600, rc 0) 00000100:00100000:2.0:1788652445.587588:0:15716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+14:14412:x1875537603708544:12345-192.168.203.50@tcp:101:bash.0 Request processed in 16144us (16660us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788652445.587613:0:15716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 28 00010000:00010000:1.0:1788652445.595003:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0400/0x340ed74ef02a8ac1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.595029:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0400/0x340ed74ef02a8ac1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.595039:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0400/0x340ed74ef02a8ac1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.595046:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75dd0400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1788652445.595051:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0400/0x340ed74ef02a8ac1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.595084:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0400/0x340ed74ef02a8ac1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.595106:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8cbe485ac000) 00010000:00010000:1.0:1788652445.595109:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652445.595115:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0400/0x340ed74ef02a8ac1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652445.595135:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0400/0x340ed74ef02a8ac1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652445.601665:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652445.601932:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603708800 00000100:00100000:3.0:1788652445.601946:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603708800 00000100:00100000:3.0:1788652445.602023:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 29 00000100:00100000:3.0:1788652445.602035:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+13:14412:x1875537603708800:12345-192.168.203.50@tcp:101:bash.0 00010000:00010000:3.0:1788652445.602067:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652445.602093:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8ad6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0d4b expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.602179:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5e00/0x340ed74ef02a8add lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.602196:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5e00/0x340ed74ef02a8add lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.602210:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5e00/0x340ed74ef02a8add lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652445.602257:0:14305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788652445.602262:0:14305:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788652445.602284:0:14305:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5e00/0x340ed74ef02a8add lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.602295:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5e00/0x340ed74ef02a8add lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.602859:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8ad6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d4b expref: 15 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.602914:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5e00/0x340ed74ef02a8add lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d4b expref: 14 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.602926:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbe485acf00) 00010000:00010000:3.0:1788652445.602929:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788652445.602933:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5e00, rc 0) 00000100:00100000:3.0:1788652445.603019:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+14:14412:x1875537603708800:12345-192.168.203.50@tcp:101:bash.0 Request processed in 986us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652445.603028:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 29 00000100:00100000:0.0:1788652445.611096:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652445.611254:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603709056 00000100:00100000:2.0:1788652445.611268:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603709056 00000100:00100000:2.0:1788652445.611346:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:2.0:1788652445.611359:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+14:14412:x1875537603709056:12345-192.168.203.50@tcp:35:bash.0 00000100:00100000:2.0:1788652445.611864:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+15:14412:x1875537603709056:12345-192.168.203.50@tcp:35:bash.0 Request processed in 505us (780us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788652445.611873:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:1.0:1788652445.705009:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652445.709418:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603709312 00000100:00100000:0.0:1788652445.709440:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603709312 00000100:00100000:0.0:1788652445.709686:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 30 00000100:00100000:0.0:1788652445.709699:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+15:14422:x1875537603709312:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1788652445.709751:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652445.709797:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8ae4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0d52 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652445.709913:0:14304:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788652445.710079:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8ae4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d52 expref: 17 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.710096:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cbe485ac100) 00010000:00010000:0.0:1788652445.710099:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788652445.710106:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8ae4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d52 expref: 17 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.710136:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe75f1b200, rc 0) 00000100:00100000:0.0:1788652445.710232:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+16:14422:x1875537603709312:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 534us (5237us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788652445.710240:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 30 00000100:00100000:1.0:1788652445.725402:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652445.725552:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603709568 00000100:00100000:2.0:1788652445.725576:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603709568 00000100:00100000:2.0:1788652445.725654:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:2.0:1788652445.725668:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+16:14422:x1875537603709568:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:2.0:1788652445.726168:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+17:14422:x1875537603709568:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 350us (629us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788652445.726179:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:1.0:1788652445.782973:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652445.783236:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603709824 00000100:00100000:0.0:1788652445.783249:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603709824 00000100:00100000:0.0:1788652445.783327:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 31 00000100:00100000:0.0:1788652445.783338:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c66a6a95-dcf9-4296-ba30-508b18ee8b72+17:14425:x1875537603709824:12345-192.168.203.50@tcp:101:lfs.0 00010000:00010000:0.0:1788652445.783368:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652445.783398:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8af2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0d59 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.783533:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8af9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.783584:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8af9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.783599:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8af9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652445.783613:0:14306:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788652445.786207:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8af2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d59 expref: 20 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.786245:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8af9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d59 expref: 19 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652445.786255:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbe485acf00) 00010000:00010000:0.0:1788652445.786258:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788652445.786263:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe75f1a400, rc 0) 00000100:00100000:0.0:1788652445.786361:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c66a6a95-dcf9-4296-ba30-508b18ee8b72+19:14425:x1875537603709824:12345-192.168.203.50@tcp:101:lfs.0 Request processed in 3023us (3402us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788652445.786371:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 31 00000100:00100000:1.0:1788652445.790148:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652445.790207:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652445.790471:0:15716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603709952 00000100:00100000:3.0:1788652445.790485:0:15716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603709952 00000100:00100000:3.0:1788652445.790642:0:15716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 32 00000100:00100000:3.0:1788652445.790657:0:15716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+19:14425:x1875537603709952:12345-192.168.203.50@tcp:54:lfs.0 00000100:00100000:2.0:1788652445.790680:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603710080 00000100:00100000:2.0:1788652445.790687:0:14291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603710080 00000100:00100000:2.0:1788652445.790738:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:2.0:1788652445.790749:0:14291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c66a6a95-dcf9-4296-ba30-508b18ee8b72+20:2347:x1875537603710080:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652445.790764:0:15716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8b07 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652445.790764:0:14291:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652445.790832:0:14291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8af9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d59 expref: 20 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.792224:0:15716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8b07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.792250:0:15716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8b07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.792292:0:15716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8b07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.792299:0:15716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8b07 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.793106:0:15716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8b07 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.793114:0:15716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1788652445.793883:0:15716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8b07 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.793900:0:15716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8b07 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.793918:0:15716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbe485acf00) 00010000:00010000:3.0:1788652445.793921:0:15716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788652445.793928:0:15716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8b07 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652445.793935:0:15716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8b07 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15716 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652445.794256:0:15716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+19:14425:x1875537603709952:12345-192.168.203.50@tcp:54:lfs.0 Request processed in 3596us (4128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652445.794274:0:15716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 32 00010000:00010000:2.0:1788652445.796068:0:14291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbe485acf00) 00010000:00010000:2.0:1788652445.796084:0:14291:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652445.796183:0:14291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c66a6a95-dcf9-4296-ba30-508b18ee8b72+18:2347:x1875537603710080:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 5430us (5967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652445.796198:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:1.0:1788652445.796890:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652445.796975:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603710336 00000100:00100000:3.0:1788652445.797051:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603710336 00000100:00100000:2.0:1788652445.797156:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:2.0:1788652445.797169:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+18:14425:x1875537603710336:12345-192.168.203.50@tcp:35:lfs.0 00000100:00100000:2.0:1788652445.797445:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+19:14425:x1875537603710336:12345-192.168.203.50@tcp:35:lfs.0 Request processed in 277us (557us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788652445.797452:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 7 00010000:00010000:0.0:1788652446.027226:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652446.061321:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652446.061961:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603710592 00000100:00100000:2.0:1788652446.061974:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603710592 00000100:00100000:2.0:1788652446.062121:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 33 00000100:00100000:2.0:1788652446.062135:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+19:14456:x1875537603710592:12345-192.168.203.50@tcp:101:cat.0 00010000:00010000:2.0:1788652446.062166:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652446.062193:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0a00/0x340ed74ef02a8b0e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0d60 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.062331:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a8b15 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.062350:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a8b15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.062365:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a8b15 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652446.062378:0:14305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788652446.062574:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0a00/0x340ed74ef02a8b0e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d60 expref: 22 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.062628:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a8b15 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d60 expref: 21 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.062638:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbe485acf00) 00010000:00010000:2.0:1788652446.062641:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788652446.062645:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe75dd0800, rc 0) 00000100:00100000:2.0:1788652446.062741:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+21:14456:x1875537603710592:12345-192.168.203.50@tcp:101:cat.0 Request processed in 609us (1433us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788652446.062748:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 33 00000100:00100000:1.0:1788652446.065911:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652446.065957:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652446.066032:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603710976 00000100:00100000:3.0:1788652446.066043:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603710976 00000100:00100000:3.0:1788652446.066097:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:3.0:1788652446.066108:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+21:14456:x1875537603710976:12345-192.168.203.50@tcp:35:cat.0 00000100:00100000:3.0:1788652446.066446:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+22:14456:x1875537603710976:12345-192.168.203.50@tcp:35:cat.0 Request processed in 338us (486us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1788652446.066467:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:0.0:1788652446.068401:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603710720 00000100:00100000:0.0:1788652446.068414:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603710720 00000100:00100000:0.0:1788652446.068496:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 1 00000100:00100000:0.0:1788652446.068506:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+22:2346:x1875537603710720:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788652446.068520:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652446.068544:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd0800/0x340ed74ef02a8b15 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d60 expref: 22 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.068594:0:14289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbe485acf00) 00010000:00010000:0.0:1788652446.068599:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652446.068659:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+21:2346:x1875537603710720:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 151us (2753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652446.068667:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 1 00000100:00100000:1.0:1788652446.140184:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652446.140271:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603711232 00000100:00100000:0.0:1788652446.140280:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603711232 00000100:00100000:0.0:1788652446.140370:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 34 00000100:00100000:0.0:1788652446.140380:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+21:14462:x1875537603711232:12345-192.168.203.50@tcp:101:dd.0 00010000:00010000:0.0:1788652446.140404:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652446.140424:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8b23 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0d67 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.140525:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1be00/0x340ed74ef02a8b2a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.140541:0:14304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8ac8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d44 expref: 22 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.140550:0:14304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5e00/0x340ed74ef02a8add lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d4b expref: 22 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.140558:0:14304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1be00/0x340ed74ef02a8b2a lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.140602:0:14304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5e00/0x340ed74ef02a8add lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d4b expref: 22 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.140636:0:14304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5e00/0x340ed74ef02a8add lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d4b expref: 22 pid: 14305 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652446.140649:0:14304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14304:1875537627813632:192.168.203.50@tcp:104: 00010000:00010000:0.0:1788652446.140739:0:14304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d44 expref: 22 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.140748:0:14304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d44 expref: 22 pid: 15716 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652446.140758:0:14304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14304:1875537627813760:192.168.203.50@tcp:104: 00000100:00100000:0.0:1788652446.140820:0:14304:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788652446.142863:0:14304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14304:1875537627813632:192.168.203.50@tcp:104: 00000100:00100000:1.0:1788652446.143054:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652446.143104:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652446.143167:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603711488 00000100:00100000:3.0:1788652446.143174:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603711488 00010000:00010000:3.0:1788652446.143209:0:14289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8ac8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d44 expref: 23 pid: 15716 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652446.143247:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603711360 00000100:00100000:3.0:1788652446.143250:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603711360 00010000:00010000:3.0:1788652446.143266:0:14289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5e00/0x340ed74ef02a8add lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d4b expref: 24 pid: 14305 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652446.143274:0:14304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14304:1875537627813760:192.168.203.50@tcp:104: 00000100:00100000:3.0:1788652446.143288:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:3.0:1788652446.143299:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a425050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+24:2347:x1875537603711488:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788652446.143306:0:14304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1be00/0x340ed74ef02a8b2a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.143311:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652446.143321:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d44 expref: 24 pid: 15716 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652446.143321:0:14290:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788652446.143333:0:14290:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788652446.143339:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d44 expref: 24 pid: 15716 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.143359:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1600/0x340ed74ef02a8ac8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d44 expref: 24 pid: 15716 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.143374:0:14289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbe485acf00) 00010000:00010000:3.0:1788652446.143379:0:14289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1be00/0x340ed74ef02a8b2a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.143399:0:14289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1be00/0x340ed74ef02a8b2a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.143407:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652446.143467:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a425050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+23:2347:x1875537603711488:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 170us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652446.143476:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:3.0:1788652446.143522:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 12 00000100:00100000:3.0:1788652446.143529:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a284700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+22:2347:x1875537603711360:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652446.143538:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652446.143546:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5e00/0x340ed74ef02a8add lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d4b expref: 22 pid: 14305 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.143569:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5e00/0x340ed74ef02a8add lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d4b expref: 22 pid: 14305 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.143585:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5e00/0x340ed74ef02a8add lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d4b expref: 22 pid: 14305 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.143597:0:14289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbe485acf00) 00010000:00010000:3.0:1788652446.143600:0:14289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1be00/0x340ed74ef02a8b2a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.143608:0:14289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1be00/0x340ed74ef02a8b2a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.143615:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1be00/0x340ed74ef02a8b2a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.143645:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652446.143667:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a284700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+21:2347:x1875537603711360:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 137us (563us total) trans 0 rc 0/0 00010000:00010000:1.0:1788652446.143673:0:14304:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1be00/0x340ed74ef02a8b2a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652446.143675:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 12 00010000:00010000:1.0:1788652446.143685:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1be00/0x340ed74ef02a8b2a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652446.144091:0:14304:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788652446.144432:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8b23 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d67 expref: 22 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.144453:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1be00/0x340ed74ef02a8b2a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d67 expref: 21 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.144459:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbe485acf00) 00010000:00010000:1.0:1788652446.144461:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788652446.144463:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe75f1be00, rc 0) 00000100:00100000:1.0:1788652446.144583:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+21:14462:x1875537603711232:12345-192.168.203.50@tcp:101:dd.0 Request processed in 4203us (4405us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788652446.144590:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 34 00000100:00100000:1.0:1788652446.146642:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652446.146948:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603711744 00000100:00100000:0.0:1788652446.146958:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603711744 00000100:00100000:0.0:1788652446.146997:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 35 00000100:00100000:0.0:1788652446.147176:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c66a6a95-dcf9-4296-ba30-508b18ee8b72+21:14462:x1875537603711744:12345-192.168.203.50@tcp:36:dd.0 00010000:00010000:0.0:1788652446.147427:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1ba00/0x340ed74ef02a8b38 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.147444:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1ba00/0x340ed74ef02a8b38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.147467:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1ba00/0x340ed74ef02a8b38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788652446.150317:0:14306:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788652446.150398:0:14306:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067d3cf7e reply state 00000000332a4755 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1ba00/0x340ed74ef02a8b38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652446.150410:0:14306:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788652446.151704:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c66a6a95-dcf9-4296-ba30-508b18ee8b72+24:14462:x1875537603711744:12345-192.168.203.50@tcp:36:dd.0 Request processed in 4579us (5061us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788652446.151715:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 35 00000020:00080000:0.0:1788652446.151722:0:14306:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788652446.156291:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00010000:00010000:0.0:1788652446.157019:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1ba00/0x340ed74ef02a8b38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.157033:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1ba00/0x340ed74ef02a8b38 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.157041:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1ba00/0x340ed74ef02a8b38 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.157047:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75f1ba00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652446.157052:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1ba00/0x340ed74ef02a8b38 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.157059:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1ba00/0x340ed74ef02a8b38 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.157076:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbe485acf00) 00010000:00010000:0.0:1788652446.157079:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652446.157099:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1ba00/0x340ed74ef02a8b38 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.157105:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1ba00/0x340ed74ef02a8b38 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652446.157112:0:15716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603711872 00000100:00100000:3.0:1788652446.157183:0:15716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603711872 00000100:00100000:3.0:1788652446.157275:0:15716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 36 00000100:00100000:3.0:1788652446.157286:0:15716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7a286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+23:14462:x1875537603711872:12345-192.168.203.50@tcp:101:dd.0 00010000:00010000:3.0:1788652446.157309:0:15716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652446.157373:0:15716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5e00/0x340ed74ef02a8b3f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0d6e expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.157430:0:15716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5e00/0x340ed74ef02a8b3f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d6e expref: 24 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.157442:0:15716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5e00/0x340ed74ef02a8b3f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d6e expref: 24 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.157461:0:15716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbe485acf00) 00010000:00010000:3.0:1788652446.157463:0:15716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788652446.157466:0:15716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7a0e5e00, rc 0) 00000100:00100000:3.0:1788652446.157613:0:15716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7a286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+24:14462:x1875537603711872:12345-192.168.203.50@tcp:101:dd.0 Request processed in 328us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652446.157621:0:15716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 36 00000100:00100000:3.0:1788652446.183873:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652446.184415:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603712128 00000100:00100000:1.0:1788652446.184426:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603712128 00000100:00100000:1.0:1788652446.184505:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:1.0:1788652446.184518:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+24:14462:x1875537603712128:12345-192.168.203.50@tcp:103:dd.0 00010000:00010000:1.0:1788652446.184537:0:14290:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652446.184569:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5e00/0x340ed74ef02a8b3f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d6e expref: 24 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.184590:0:14290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbe485acf00) 00010000:00010000:1.0:1788652446.184595:0:14290:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652446.184659:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+23:14462:x1875537603712128:12345-192.168.203.50@tcp:103:dd.0 Request processed in 144us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652446.184682:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:3.0:1788652446.186447:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652446.186767:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603712256 00000100:00100000:2.0:1788652446.186800:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603712256 00000100:00100000:2.0:1788652446.186850:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 37 00000100:00100000:2.0:1788652446.186864:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f2fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+23:14462:x1875537603712256:12345-192.168.203.50@tcp:58:dd.0 00010000:00010000:2.0:1788652446.186960:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1000/0x340ed74ef02a8b46 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.186976:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1000/0x340ed74ef02a8b46 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.186999:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1000/0x340ed74ef02a8b46 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788652446.188982:0:14305:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788652446.189548:0:14305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788652446.189630:0:14305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788652446.190164:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f2fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+23:14462:x1875537603712256:12345-192.168.203.50@tcp:58:dd.0 Request processed in 3296us (3719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652446.190187:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 37 00000100:00100000:2.0:1788652446.192834:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652446.195573:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603712384 00000100:00100000:1.0:1788652446.195587:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603712384 00000100:00100000:1.0:1788652446.195657:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 38 00000100:00100000:1.0:1788652446.195667:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+23:14462:x1875537603712384:12345-192.168.203.50@tcp:101:dd.0 00010000:00010000:1.0:1788652446.195685:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652446.195703:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10600/0x340ed74ef02a8b4d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0d75 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.195759:0:14304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1000/0x340ed74ef02a8b46 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.195789:0:14304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10600/0x340ed74ef02a8b4d lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d75 expref: 24 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.195812:0:14304:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1000/0x340ed74ef02a8b46 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.195837:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10600/0x340ed74ef02a8b4d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d75 expref: 24 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.195851:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbe485acf00) 00010000:00010000:1.0:1788652446.195854:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788652446.195858:0:14304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10600/0x340ed74ef02a8b4d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d75 expref: 24 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.195866:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe7fd10600, rc 0) 00000100:00100000:1.0:1788652446.195940:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+24:14462:x1875537603712384:12345-192.168.203.50@tcp:101:dd.0 Request processed in 274us (3114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652446.195947:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 38 00000100:00100000:3.0:1788652446.385879:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652446.386218:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603712512 00000100:00100000:2.0:1788652446.386227:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603712512 00000100:00100000:2.0:1788652446.386282:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 120 00000100:00100000:2.0:1788652446.386292:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f930850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+13:2346:x1875537603712512:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:2.0:1788652446.386366:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f930850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd83be1f-82a0-4980-8afc-69f413012e95+13:2346:x1875537603712512:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 75us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652446.386374:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 120 00000100:00100000:0.0:1788652446.390054:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652446.390091:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652446.390135:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652446.390181:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652446.390207:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603712640 00000100:00100000:0.0:1788652446.390217:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603712640 00000100:00100000:0.0:1788652446.390274:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603712896 00000100:00100000:0.0:1788652446.390278:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603712896 00000100:00100000:0.0:1788652446.390291:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603712768 00000100:00100000:0.0:1788652446.390294:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603712768 00000100:00100000:0.0:1788652446.390305:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603713024 00000100:00100000:0.0:1788652446.390307:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603713024 00000100:00100000:0.0:1788652446.390321:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:0.0:1788652446.390330:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+5:2346:x1875537603712640:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1788652446.390402:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+5:2346:x1875537603712640:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 73us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652446.390410:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:0.0:1788652446.390426:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:0.0:1788652446.390432:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8fbfa306-1be4-498a-9298-3679b70726ba+5:2347:x1875537603712896:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1788652446.390454:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8fbfa306-1be4-498a-9298-3679b70726ba+5:2347:x1875537603712896:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 22us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652446.390460:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 8 00000100:00100000:0.0:1788652446.390472:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:0.0:1788652446.390493:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe5f8fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+5:2347:x1875537603712768:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1788652446.390517:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe5f8fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+5:2347:x1875537603712768:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 25us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652446.390523:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:0.0:1788652446.390535:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:0.0:1788652446.390541:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8fbfa306-1be4-498a-9298-3679b70726ba+5:2347:x1875537603713024:12345-192.168.203.50@tcp:400:kworker.0 00000100:00100000:0.0:1788652446.390573:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8fbfa306-1be4-498a-9298-3679b70726ba+5:2347:x1875537603713024:12345-192.168.203.50@tcp:400:kworker.0 Request processed in 31us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652446.390580:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00080000:3.0:1788652446.390802:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788652446.390807:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788652446.409294:0:14338:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788652446.409304:0:14338:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788652446.409340:0:14338:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788652446.409463:0:14338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788652446.409603:0:14338:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f90f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14338:1875537627813888:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788652446.409758:0:14338:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4a5d70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652446.427933:0:14338:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f90f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14338:1875537627813888:192.168.203.50@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788652446.429425:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652446.429510:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603713152 00000100:00100000:2.0:1788652446.429519:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603713152 00000100:00100000:2.0:1788652446.429623:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:2.0:1788652446.429633:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+24:14463:x1875537603713152:12345-192.168.203.50@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788652446.429729:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+24:14463:x1875537603713152:12345-192.168.203.50@tcp:900:lhsmtool_posix.0 Request processed in 97us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652446.429738:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:0.0:1788652446.438716:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652446.440044:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603713280 00000100:00100000:1.0:1788652446.440057:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603713280 00000100:00100000:1.0:1788652446.440127:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 39 00000100:00100000:1.0:1788652446.440139:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c66a6a95-dcf9-4296-ba30-508b18ee8b72+24:14463:x1875537603713280:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788652446.440171:0:14306:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788652446.440293:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c66a6a95-dcf9-4296-ba30-508b18ee8b72+24:14463:x1875537603713280:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 156us (1585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652446.440301:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 39 00000100:00100000:1.0:1788652446.445253:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652446.445374:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603713408 00000100:00100000:0.0:1788652446.445384:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603713408 00000100:00100000:0.0:1788652446.445437:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 40 00000100:00100000:0.0:1788652446.445446:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+24:14463:x1875537603713408:12345-192.168.203.50@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788652446.445515:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8b54 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.445532:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8b54 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.445545:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8b54 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.445590:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8b5b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.445598:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8b5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.445617:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8b5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.445639:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b000/0x340ed74ef02a8b62 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.445647:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b000/0x340ed74ef02a8b62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.445654:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b000/0x340ed74ef02a8b62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652446.445690:0:14304:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788652446.445694:0:14304:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788652446.445710:0:14304:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b000/0x340ed74ef02a8b62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.445721:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8b54 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.445728:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8b54 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.445735:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8b54 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.445740:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75f1b800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652446.445744:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8b54 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.445752:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8b54 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.446234:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbe48da0c00) 00010000:00010000:0.0:1788652446.446239:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652446.446244:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8b54 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.446251:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8b54 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.446266:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8b5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.446272:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8b5b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.446278:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8b5b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.446283:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75f1b200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652446.446286:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8b5b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.446292:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8b5b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.446299:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8cbe4b956c00) 00010000:00010000:0.0:1788652446.446301:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652446.446304:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8b5b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.446309:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8b5b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.446333:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b000/0x340ed74ef02a8b62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.446339:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b000/0x340ed74ef02a8b62 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.446345:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b000/0x340ed74ef02a8b62 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.446349:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75f1b000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652446.446352:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b000/0x340ed74ef02a8b62 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.446357:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b000/0x340ed74ef02a8b62 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.446364:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbe485acf00) 00010000:00010000:0.0:1788652446.446366:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652446.446369:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b000/0x340ed74ef02a8b62 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.446374:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b000/0x340ed74ef02a8b62 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652446.446495:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+24:14463:x1875537603713408:12345-192.168.203.50@tcp:34:lhsmtool_posix.0 Request processed in 1048us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652446.446504:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 40 00000100:00100000:3.0:1788652446.448725:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652446.448856:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603713664 00000100:00100000:2.0:1788652446.448875:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603713664 00000100:00100000:2.0:1788652446.448964:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 41 00000100:00100000:2.0:1788652446.448974:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbd41fa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+24:14463:x1875537603713664:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788652446.448993:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652446.449012:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1c00/0x340ed74ef02a8b69 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0d7c expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.449104:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1e00/0x340ed74ef02a8b70 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.449119:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1e00/0x340ed74ef02a8b70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.449131:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1e00/0x340ed74ef02a8b70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652446.449142:0:14305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788652446.449230:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1e00/0x340ed74ef02a8b70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.449238:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1e00/0x340ed74ef02a8b70 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.449245:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1e00/0x340ed74ef02a8b70 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.449251:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75dd1e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1788652446.449255:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1e00/0x340ed74ef02a8b70 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.449262:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1e00/0x340ed74ef02a8b70 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.449279:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbe485acf00) 00010000:00010000:2.0:1788652446.449282:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788652446.449286:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1e00/0x340ed74ef02a8b70 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.449293:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1e00/0x340ed74ef02a8b70 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.449344:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1c00/0x340ed74ef02a8b69 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d7c expref: 26 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.449354:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cbe48da0c00) 00010000:00010000:2.0:1788652446.449357:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788652446.449361:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1c00/0x340ed74ef02a8b69 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d7c expref: 26 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.449370:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe75dd1c00, rc 0) 00000100:00100000:2.0:1788652446.449428:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbd41fa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+25:14463:x1875537603713664:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 455us (711us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1788652446.449435:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 41 00000100:00100000:3.0:1788652446.453858:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652446.453974:0:15716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603713792 00000100:00100000:2.0:1788652446.453984:0:15716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603713792 00000100:00100000:2.0:1788652446.454050:0:15716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 42 00000100:00100000:2.0:1788652446.454062:0:15716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+25:14463:x1875537603713792:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788652446.454094:0:15716:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788652446.454203:0:15716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+25:14463:x1875537603713792:12345-192.168.203.50@tcp:53:lhsmtool_posix.0 Request processed in 144us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652446.454227:0:15716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 42 00000100:00100000:3.0:1788652446.457445:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652446.457619:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603714048 00000100:00100000:1.0:1788652446.457629:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603714048 00000100:00100000:1.0:1788652446.457682:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 43 00000100:00100000:1.0:1788652446.457692:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c66a6a95-dcf9-4296-ba30-508b18ee8b72+25:14463:x1875537603714048:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788652446.457712:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652446.457743:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11800/0x340ed74ef02a8b7e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0d83 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788652446.458920:0:14306:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1788652446.458927:0:14306:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1788652446.458981:0:14306:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1788652446.459537:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b000/0x340ed74ef02a8b85 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.459554:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b000/0x340ed74ef02a8b85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.459601:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b000/0x340ed74ef02a8b85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.459659:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd11800/0x340ed74ef02a8b7e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d83 expref: 28 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.459677:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b000/0x340ed74ef02a8b85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d83 expref: 27 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.459686:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cbe4b956c00) 00010000:00010000:0.0:1788652446.459689:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788652446.459692:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe75f1b000, rc 0) 00000100:00100000:0.0:1788652446.459963:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c66a6a95-dcf9-4296-ba30-508b18ee8b72+27:14463:x1875537603714048:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 2271us (2525us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788652446.459972:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 43 00000100:00100000:3.0:1788652446.463046:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652446.463337:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603714304 00000100:00100000:0.0:1788652446.463346:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603714304 00000100:00100000:0.0:1788652446.463408:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 44 00000100:00100000:0.0:1788652446.463418:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+27:14463:x1875537603714304:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788652446.463467:0:14304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652446.463491:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b000/0x340ed74ef02a8b85 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d83 expref: 27 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.463527:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cbe4b956c00) 00010000:00010000:0.0:1788652446.463542:0:14304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788652446.463572:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8b93 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.463585:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8b93 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.463595:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8b93 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.463609:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8b9a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe73452c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.463616:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8b9a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe73452c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.463623:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8b9a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe73452c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.463677:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8b93 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.463684:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8b93 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.463690:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8b93 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.463696:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75f1b200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652446.463700:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8b93 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.463713:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8b93 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.463722:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cbe4b956b00) 00010000:00010000:0.0:1788652446.463724:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652446.463817:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8b93 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.463825:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8b93 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.463835:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8b9a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe73452c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.463842:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8b9a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe73452c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.463849:0:14304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8b9a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe73452c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.463854:0:14304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75f1b800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652446.463858:0:14304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8b9a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe73452c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.463863:0:14304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8b9a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xe73452c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.463872:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xe73452c (ffff8cbe4b956800) 00010000:00010000:0.0:1788652446.463875:0:14304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652446.463879:0:14304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8b9a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe73452c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.463895:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8b9a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xe73452c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652446.463968:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+26:14463:x1875537603714304:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 552us (941us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788652446.463976:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 44 00000100:00100000:3.0:1788652446.467133:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652446.467711:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603714432 00000100:00100000:2.0:1788652446.467721:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603714432 00000100:00100000:2.0:1788652446.467798:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 45 00000100:00100000:2.0:1788652446.467809:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+26:14463:x1875537603714432:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788652446.467828:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652446.467852:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1c00/0x340ed74ef02a8ba1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0d8a expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.467888:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1e00/0x340ed74ef02a8ba8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.467902:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1e00/0x340ed74ef02a8ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.467915:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1e00/0x340ed74ef02a8ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.468007:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1c00/0x340ed74ef02a8ba1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d8a expref: 28 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.468027:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1e00/0x340ed74ef02a8ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d8a expref: 27 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.468050:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cbe485ac600) 00010000:00010000:2.0:1788652446.468053:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788652446.468057:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe75dd1e00, rc 0) 00000100:00100000:2.0:1788652446.468130:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+27:14463:x1875537603714432:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 323us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652446.468144:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 45 00000100:00100000:3.0:1788652446.474148:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652446.474231:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603714688 00000100:00100000:0.0:1788652446.474241:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603714688 00000100:00100000:0.0:1788652446.474297:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 46 00000100:00100000:0.0:1788652446.474307:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+27:14463:x1875537603714688:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788652446.474394:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8baf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.474411:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8baf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.474422:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8baf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788652446.474862:0:14304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1788652446.474872:0:14304:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 463458099769ns, next at 464458097247ns, rc = 0 00000004:00010000:0.0:1788652446.474960:0:14304:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000265e11e7 reply state 0000000010f1d8c8 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8baf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652446.474970:0:14304:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788652446.475062:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+29:14463:x1875537603714688:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 756us (921us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788652446.475069:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 46 00000100:00100000:3.0:1788652446.477359:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652446.477482:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603714816 00000100:00100000:0.0:1788652446.477491:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603714816 00000100:00100000:0.0:1788652446.477543:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 47 00000100:00100000:0.0:1788652446.477553:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c66a6a95-dcf9-4296-ba30-508b18ee8b72+29:14463:x1875537603714816:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788652446.477582:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652446.477601:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8bb6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0d91 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.477633:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8baf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.477645:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8baf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.477652:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8baf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.477660:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8bb6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d91 expref: 30 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.477676:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75f1b800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652446.477677:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8bb6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d91 expref: 30 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.477683:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8baf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.477699:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cbe485ac600) 00010000:00010000:0.0:1788652446.477703:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788652446.477707:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe75f1b200, rc 0) 00000100:00100000:0.0:1788652446.477759:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c66a6a95-dcf9-4296-ba30-508b18ee8b72+30:14463:x1875537603714816:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 207us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652446.477765:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 47 00010000:00010000:1.0:1788652446.477885:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8baf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.477898:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cbe485ac600) 00010000:00010000:1.0:1788652446.477901:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788652446.477906:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8baf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.477913:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b800/0x340ed74ef02a8baf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652446.481112:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652446.481273:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603714944 00000100:00100000:0.0:1788652446.481283:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603714944 00000100:00100000:0.0:1788652446.481378:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:0.0:1788652446.481387:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+5:2347:x1875537603714944:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788652446.481797:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+6:2347:x1875537603714944:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 Request processed in 410us (693us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788652446.481803:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:3.0:1788652446.483897:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652446.483973:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603715200 00000100:00100000:2.0:1788652446.483982:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603715200 00000100:00100000:2.0:1788652446.484031:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:2.0:1788652446.484041:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+29:14463:x1875537603715200:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788652446.484496:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+30:14463:x1875537603715200:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 451us (598us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1788652446.484505:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 9 00000100:00100000:1.0:1788652446.486417:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652446.486694:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603715456 00000100:00100000:0.0:1788652446.486704:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603715456 00000100:00100000:0.0:1788652446.486923:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 48 00000100:00100000:0.0:1788652446.486934:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+30:14463:x1875537603715456:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788652446.487039:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+30:14463:x1875537603715456:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 107us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652446.487055:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 48 00000100:00100000:3.0:1788652446.489001:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652446.489298:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603715584 00000100:00100000:0.0:1788652446.489307:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603715584 00000100:00100000:0.0:1788652446.489372:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00100000:0.0:1788652446.489381:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c66a6a95-dcf9-4296-ba30-508b18ee8b72+30:14463:x1875537603715584:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788652446.489398:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652446.489418:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b000/0x340ed74ef02a8bbd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0d98 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.489480:0:14306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1ae00/0x340ed74ef02a8bc4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.489494:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1ae00/0x340ed74ef02a8bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.489506:0:14306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1ae00/0x340ed74ef02a8bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652446.489543:0:14306:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788652446.489573:0:14306:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1ae00/0x340ed74ef02a8bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.489599:0:14306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b000/0x340ed74ef02a8bbd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d98 expref: 32 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.489634:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1ae00/0x340ed74ef02a8bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d98 expref: 31 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.489642:0:14306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cbe485ac600) 00010000:00010000:0.0:1788652446.489645:0:14306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788652446.489649:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe75f1ae00, rc 0) 00000100:00100000:0.0:1788652446.489712:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c66a6a95-dcf9-4296-ba30-508b18ee8b72+31:14463:x1875537603715584:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 332us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652446.489719:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 49 00000100:00100000:1.0:1788652446.492697:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652446.492957:0:15835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603715712 00000100:00100000:2.0:1788652446.492966:0:15835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603715712 00000100:00100000:2.0:1788652446.493052:0:15835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:2.0:1788652446.493063:0:15835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+6:2346:x1875537603715712:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788652446.493078:0:15835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652446.493099:0:15835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d3aef04/0x340ed74ef02a8bcb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2b021b6b880f0d9f expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788652446.493137:0:15835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cab9d, blocks: 0x1 00010000:00010000:2.0:1788652446.493156:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1788652446.493161:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652446.493169:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d3aef04/0x340ed74ef02a8bcb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d9f expref: 7 pid: 15835 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.493188:0:15835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007d3aef04/0x340ed74ef02a8bcb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d9f expref: 7 pid: 15835 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.493218:0:15835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cbe75dd1c00, rc 0) 00000100:00100000:2.0:1788652446.493275:0:15835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+7:2346:x1875537603715712:12345-192.168.203.50@tcp:101:lhsmtool_posix.0 Request processed in 215us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652446.493282:0:15835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:1.0:1788652446.496845:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652446.496914:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603715968 00000100:00100000:0.0:1788652446.496923:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603715968 00000100:00100000:0.0:1788652446.496970:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 50 00000100:00100000:0.0:1788652446.496981:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+31:14463:x1875537603715968:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788652446.497074:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+31:14463:x1875537603715968:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 96us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652446.497079:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 50 00000100:00100000:3.0:1788652446.499590:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652446.499675:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603716096 00000100:00100000:0.0:1788652446.499685:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603716096 00000100:00100000:0.0:1788652446.499740:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 51 00000100:00100000:0.0:1788652446.499750:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c66a6a95-dcf9-4296-ba30-508b18ee8b72+31:14463:x1875537603716096:12345-192.168.203.50@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788652446.549607:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:3.0:1788652446.549620:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788652446.549648:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:3.0:1788652446.549679:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:3.0:1788652446.549699:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1788652446.549867:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788652446.549885:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe51381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627814016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788652446.549943:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652446.550006:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627814016 00000100:00100000:1.0:1788652446.550012:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627814016 00000100:00100000:1.0:1788652446.550061:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788652446.550070:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51380a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627814016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788652446.550217:0:14990:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788652446.550221:0:14990:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788652446.550223:0:14990:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788652446.550234:0:14990:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788652445 -> 1788652445 00002000:00010000:1.0:1788652446.550237:0:14990:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788652446.550276:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51380a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1875537627814016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 206us (333us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788652446.550284:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788652446.550304:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788652446.550450:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cbe51381c00/2, rc 0, transno 8589934595 00000100:00100000:1.0:1788652446.550457:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe51381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627814016:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788652446.550648:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c66a6a95-dcf9-4296-ba30-508b18ee8b72+14:14463:x1875537603716096:12345-192.168.203.50@tcp:44:lhsmtool_posix.0 Request processed in 50897us (51063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652446.550657:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 51 00000100:00100000:1.0:1788652446.555241:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652446.555378:0:14989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603716224 00000100:00100000:3.0:1788652446.555388:0:14989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603716224 00000100:00100000:3.0:1788652446.555487:0:14989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:3.0:1788652446.555498:0:14989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51382300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+7:2346:x1875537603716224:12345-192.168.203.50@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788652446.555628:0:14989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51382300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+7:2346:x1875537603716224:12345-192.168.203.50@tcp:16:lhsmtool_posix.0 Request processed in 131us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652446.555635:0:14989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:1.0:1788652446.558189:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652446.558280:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603716480 00000100:00100000:0.0:1788652446.558290:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603716480 00000100:00100000:0.0:1788652446.558431:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 52 00000100:00100000:0.0:1788652446.558441:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+14:14463:x1875537603716480:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788652446.558502:0:14304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652446.558526:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1ae00/0x340ed74ef02a8bc4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d98 expref: 14 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.558545:0:14304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cbe485ac600) 00010000:00010000:0.0:1788652446.558550:0:14304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788652446.558588:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8bd2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.558602:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8bd2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.558611:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8bd2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788652446.558844:0:14304:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000753adba7 reply state 00000000ad262dde transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8bd2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652446.558853:0:14304:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788652446.558935:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+15:14463:x1875537603716480:12345-192.168.203.50@tcp:36:lhsmtool_posix.0 Request processed in 494us (753us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788652446.558942:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 52 00000100:00100000:1.0:1788652446.561814:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652446.562216:0:14990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603716608 00000100:00100000:3.0:1788652446.562239:0:14990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603716608 00000100:00100000:3.0:1788652446.562288:0:14990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00100000:3.0:1788652446.562298:0:14990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51380380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c66a6a95-dcf9-4296-ba30-508b18ee8b72+7:2346:x1875537603716608:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788652446.562479:0:14990:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788652446.562483:0:14990:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788652444 00002000:00010000:3.0:1788652446.562485:0:14990:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788652444 00002000:00010000:3.0:1788652446.562487:0:14990:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788652445 -> 1788652444 00002000:00010000:3.0:1788652446.562490:0:14990:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788652446.562684:0:14990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51380380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c66a6a95-dcf9-4296-ba30-508b18ee8b72+8:2346:x1875537603716608:12345-192.168.203.50@tcp:2:lhsmtool_posix.0 Request processed in 386us (877us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788652446.562692:0:14990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 14 00010000:00010000:0.0:1788652446.563022:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8bd2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.563033:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8bd2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.563041:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8bd2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.563059:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75f1a400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652446.563064:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8bd2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.563072:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8bd2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.563087:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cbe485ac600) 00010000:00010000:0.0:1788652446.563090:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652446.563095:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8bd2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.563102:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8bd2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652446.566988:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652446.567083:0:15835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603716736 00000100:00100000:2.0:1788652446.567093:0:15835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603716736 00000100:00100000:2.0:1788652446.567242:0:15835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00100000:2.0:1788652446.567252:0:15835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51381180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+8:2347:x1875537603716736:12345-192.168.203.50@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788652446.567294:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f7e3d8c/0x340ed74ef02a8bd9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.567321:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652446.567326:0:15835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652446.567332:0:15835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f7e3d8c/0x340ed74ef02a8bd9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.567346:0:15835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f7e3d8c/0x340ed74ef02a8bd9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.567384:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f7e3d8c/0x340ed74ef02a8bd9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.567409:0:15835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f7e3d8c/0x340ed74ef02a8bd9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.567418:0:15835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f7e3d8c/0x340ed74ef02a8bd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.567425:0:15835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75dd0000 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652446.567429:0:15835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f7e3d8c/0x340ed74ef02a8bd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.567439:0:15835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f7e3d8c/0x340ed74ef02a8bd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.567454:0:15835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f7e3d8c/0x340ed74ef02a8bd9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.567461:0:15835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f7e3d8c/0x340ed74ef02a8bd9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652446.567540:0:15835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51381180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+8:2347:x1875537603716736:12345-192.168.203.50@tcp:1:lhsmtool_posix.0 Request processed in 289us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652446.567548:0:15835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 15 00000100:00100000:2.0:1788652446.572553:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652446.572710:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603716992 00000100:00100000:3.0:1788652446.572719:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603716992 00000100:00100000:3.0:1788652446.572800:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 53 00000100:00100000:3.0:1788652446.572811:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+14:14463:x1875537603716992:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788652446.572886:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8be0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.572903:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8be0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.572915:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8be0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.573152:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a8be7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.573162:0:14305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8bb6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d91 expref: 15 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.573180:0:14305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a8be7 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.573213:0:14305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8bb6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d91 expref: 15 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.573227:0:14305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8bb6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d91 expref: 15 pid: 14306 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652446.573241:0:14305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75984000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14305:1875537627814144:192.168.203.50@tcp:104: 00000100:00100000:3.0:1788652446.573329:0:14305:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe4f38f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652446.575900:0:14305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75984000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14305:1875537627814144:192.168.203.50@tcp:104: 00010000:00010000:0.0:1788652446.575929:0:14305:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a8be7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652446.577709:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652446.577822:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603717120 00000100:00100000:3.0:1788652446.577832:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603717120 00010000:00010000:3.0:1788652446.577868:0:14289:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8bb6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d91 expref: 16 pid: 14306 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652446.577902:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 13 00000100:00100000:3.0:1788652446.577911:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+16:2346:x1875537603717120:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652446.577926:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652446.577934:0:14289:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8bb6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d91 expref: 16 pid: 14306 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.577945:0:14289:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8bb6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d91 expref: 16 pid: 14306 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.577967:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1b200/0x340ed74ef02a8bb6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d91 expref: 16 pid: 14306 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.577999:0:14289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cbe485ac600) 00010000:00010000:3.0:1788652446.578005:0:14289:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a8be7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.578014:0:14289:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a8be7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.578022:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a8be7 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.578048:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652446.578095:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+15:2346:x1875537603717120:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 184us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652446.578102:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 13 00010000:00010000:0.0:1788652446.578227:0:14305:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a8be7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.578236:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a8be7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788652446.578417:0:14305:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1788652446.578549:0:14305:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1788652446.578607:0:14305:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1788652446.578682:0:14305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f8d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14305:1875537627814272:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788652446.578760:0:14305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652446.578825:0:14305:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652446.579022:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627814272 00000100:00100000:3.0:1788652446.579028:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627814272 00000100:00100000:3.0:1788652446.579065:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788652446.579074:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14305:x1875537627814272:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788652446.579145:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14305:x1875537627814272:12345-0@lo:1000:mdt00_001.0 Request processed in 72us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652446.579152:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788652446.579230:0:14305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f8d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14305:1875537627814272:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788652446.581220:0:14305:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1788652446.581303:0:14305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f8d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14305:1875537627814400:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788652446.581481:0:14305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652446.581509:0:14305:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb540 going to sleep for 11 seconds 00000100:00100000:1.0:1788652446.581624:0:14309:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627814400 00000100:00100000:1.0:1788652446.581631:0:14309:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627814400 00000100:00100000:1.0:1788652446.581676:0:14309:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788652446.581684:0:14309:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14305:x1875537627814400:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788652446.581882:0:14309:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14305:x1875537627814400:12345-0@lo:1000:mdt00_001.0 Request processed in 198us (400us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788652446.581890:0:14309:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788652446.582275:0:14305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f8d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14305:1875537627814400:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788652446.582312:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a8be7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.582333:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a8be7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.582341:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a8be7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.582356:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652446.582361:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a8be7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.582369:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a8be7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.582384:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cbe485ac600) 00010000:00010000:0.0:1788652446.582386:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788652446.582391:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a8be7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.582397:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e5a00/0x340ed74ef02a8be7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.582439:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1000/0x340ed74ef02a8b46 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.582446:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1000/0x340ed74ef02a8b46 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.582451:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1000/0x340ed74ef02a8b46 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.582455:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75dd1000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652446.582458:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1000/0x340ed74ef02a8b46 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.582464:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1000/0x340ed74ef02a8b46 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.582471:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbe485acf00) 00010000:00010000:0.0:1788652446.582473:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788652446.582480:0:14305:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10600/0x340ed74ef02a8b4d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d75 expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.582491:0:14305:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10600/0x340ed74ef02a8b4d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d75 expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.582501:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10600/0x340ed74ef02a8b4d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d75 expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.582529:0:14305:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7fd10600/0x340ed74ef02a8b4d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d75 expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652446.582552:0:14305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f8d2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14305:1875537627814528:192.168.203.50@tcp:105: 00000100:00100000:0.0:1788652446.582631:0:14305:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe7fcbb540 going to sleep for 11 seconds 00000100:00100000:2.0:1788652446.588757:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652446.588872:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603717248 00000100:00100000:3.0:1788652446.588881:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603717248 00000100:00100000:3.0:1788652446.588935:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:3.0:1788652446.588947:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f134c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+19:14462:x1875537603717248:12345-192.168.203.50@tcp:49:dd.0 00000100:00100000:3.0:1788652446.589064:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f134c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+19:14462:x1875537603717248:12345-192.168.203.50@tcp:49:dd.0 Request processed in 119us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652446.589081:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 10 00000100:00100000:0.0:1788652446.589886:0:14305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f8d2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14305:1875537627814528:192.168.203.50@tcp:105: 00010000:00010000:0.0:1788652446.589914:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1000/0x340ed74ef02a8b46 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.589936:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75dd1000/0x340ed74ef02a8b46 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.589968:0:14305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8bee lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.589982:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8bee lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.589992:0:14305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8bee lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.589999:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8bee lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.590003:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8bee lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.590007:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8bee lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.590010:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75f1a400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652446.590013:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8bee lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.590025:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8bee lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.590033:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbe485acf00) 00010000:00010000:0.0:1788652446.590036:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652446.590039:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8bee lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.590045:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a400/0x340ed74ef02a8bee lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.590055:0:14305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8be0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.590060:0:14305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8be0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.590066:0:14305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8be0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.590071:0:14305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1788652446.590073:0:14305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8be0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.590079:0:14305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8be0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.590087:0:14305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cbe485acf00) 00010000:00010000:0.0:1788652446.590090:0:14305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788652446.590093:0:14305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8be0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.590105:0:14305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe7a0e4200/0x340ed74ef02a8be0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14305 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652446.590618:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+18:14463:x1875537603716992:12345-192.168.203.50@tcp:57:lhsmtool_posix.0 Request processed in 17806us (18070us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788652446.590628:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 53 00000020:00080000:0.0:1788652446.590633:0:14305:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788652446.593317:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652446.593450:0:14308:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603717504 00000100:00100000:0.0:1788652446.593459:0:14308:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603717504 00000100:00100000:0.0:1788652446.593517:0:14308:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 11 00000100:00100000:0.0:1788652446.593528:0:14308:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+18:14463:x1875537603717504:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788652446.594141:0:14308:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788652446.594235:0:14308:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788652446.594275:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8bf5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.594291:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8bf5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.594303:0:14308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8bf5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.594311:0:14308:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8bf5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.594317:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8bf5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.594323:0:14308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8bf5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.594656:0:14308:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788652446.594759:0:14308:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+20:14463:x1875537603717504:12345-192.168.203.50@tcp:35:lhsmtool_posix.0 Request processed in 1230us (1457us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788652446.594768:0:14308:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 11 00000020:00080000:0.0:1788652446.594795:0:14308:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1788652446.601663:0:14338:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788652446.601678:0:14338:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788652446.601710:0:14338:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788652446.601720:0:14338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788652446.601975:0:14293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652446.601985:0:14293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8bf5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.601996:0:14293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75f1a200 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:1.0:1788652446.602000:0:14293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8bf5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.602011:0:14293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8bf5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.602036:0:14293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cbe485ac600) 00010000:00010000:1.0:1788652446.602040:0:14293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788652446.602046:0:14293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8bf5 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.602052:0:14293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cbe75f1a200/0x340ed74ef02a8bf5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14308 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.602065:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652446.602067:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652446.602068:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652446.745121:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652446.745166:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652446.745338:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603717760 00000100:00100000:1.0:1788652446.745348:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603717760 00000100:00100000:1.0:1788652446.745416:0:14994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603717632 00000100:00100000:1.0:1788652446.745419:0:14994:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603717632 00000100:00100000:1.0:1788652446.745437:0:14994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 0 00000100:00100000:1.0:1788652446.745446:0:14994:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+9:2348:x1875537603717760:12345-192.168.203.50@tcp:4:dd.0 00010000:00010000:1.0:1788652446.745490:0:14994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dab9ed5a/0x340ed74ef02a8bfc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.745511:0:14994:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007d3aef04/0x340ed74ef02a8bcb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d9f expref: 9 pid: 15835 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.745520:0:14994:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652446.745524:0:14994:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652446.745529:0:14994:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dab9ed5a/0x340ed74ef02a8bfc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.745585:0:14994:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007d3aef04/0x340ed74ef02a8bcb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d9f expref: 9 pid: 15835 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.745600:0:14994:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007d3aef04/0x340ed74ef02a8bcb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d9f expref: 9 pid: 15835 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652446.745613:0:14994:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe51383800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:14994:1875537627814656:192.168.203.50@tcp:104: 00000100:00100000:1.0:1788652446.745706:0:14994:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cbe42b56a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788652446.759215:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:2.0:1788652446.759290:0:14995:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788652446.759300:0:14995:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1788652446.759942:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603717888 00000100:00100000:2.0:1788652446.759952:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603717888 00000100:00100000:3.0:1788652446.763405:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652446.763456:0:16535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603718016 00000100:00100000:3.0:1788652446.763465:0:16535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603718016 00000100:00100000:1.0:1788652446.763487:0:16538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 1 00010000:00010000:3.0:1788652446.763501:0:16535:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007d3aef04/0x340ed74ef02a8bcb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d9f expref: 11 pid: 15835 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652446.763503:0:16538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+11:2348:x1875537603717632:12345-192.168.203.50@tcp:4:dd.0 00000100:00100000:3.0:1788652446.763548:0:16535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 14 00000100:00100000:3.0:1788652446.763568:0:16535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75985180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+11:2346:x1875537603718016:12345-192.168.203.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652446.763581:0:16535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652446.763584:0:16538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf005f4/0x340ed74ef02a8c03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.763601:0:16538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652446.763606:0:16538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652446.763611:0:16538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edf005f4/0x340ed74ef02a8c03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652446.768075:0:14994:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe51383800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:14994:1875537627814656:192.168.203.50@tcp:104: 00010000:00010000:1.0:1788652446.768424:0:16538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000edf005f4/0x340ed74ef02a8c03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.768426:0:16535:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007d3aef04/0x340ed74ef02a8bcb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d9f expref: 11 pid: 15835 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.771531:0:16535:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007d3aef04/0x340ed74ef02a8bcb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d9f expref: 11 pid: 15835 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.771624:0:14994:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dab9ed5a/0x340ed74ef02a8bfc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.772022:0:16535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d3aef04/0x340ed74ef02a8bcb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.50@tcp remote: 0x2b021b6b880f0d9f expref: 11 pid: 15835 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.772042:0:16535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652446.772046:0:16535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652446.772068:0:16535:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dab9ed5a/0x340ed74ef02a8bfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.772079:0:16535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dab9ed5a/0x340ed74ef02a8bfc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.772090:0:16535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652446.772092:0:16535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652446.772097:0:16535:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000edf005f4/0x340ed74ef02a8c03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.772103:0:16535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edf005f4/0x340ed74ef02a8c03 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.773025:0:16535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788652446.773047:0:16538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000edf005f4/0x340ed74ef02a8c03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652446.773061:0:16538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edf005f4/0x340ed74ef02a8c03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652446.773102:0:16535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75985180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+10:2346:x1875537603718016:12345-192.168.203.50@tcp:103:ldlm_bl.0 Request processed in 9542us (9704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652446.773178:0:16535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 14 00010000:00010000:3.0:1788652446.773267:0:14994:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dab9ed5a/0x340ed74ef02a8bfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.773276:0:14994:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dab9ed5a/0x340ed74ef02a8bfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788652446.860071:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:1.0:1788652446.860097:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:3.0:1788652446.860426:0:16538:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1788652446.860431:0:16538:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788652444 -> 1788652445 00002000:00010000:3.0:1788652446.860434:0:16538:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1788652446.860449:0:16538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edf005f4/0x340ed74ef02a8c03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.860463:0:16538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edf005f4/0x340ed74ef02a8c03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.860488:0:16538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edf005f4/0x340ed74ef02a8c03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.860496:0:16538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7fd10000 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:3.0:1788652446.860501:0:16538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf005f4/0x340ed74ef02a8c03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.860510:0:16538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edf005f4/0x340ed74ef02a8c03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.860529:0:16538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edf005f4/0x340ed74ef02a8c03 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.860537:0:16538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edf005f4/0x340ed74ef02a8c03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652446.860627:0:16538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+10:2348:x1875537603717632:12345-192.168.203.50@tcp:4:dd.0 Request processed in 97125us (115455us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788652446.860641:0:16538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 1 00000100:00100000:3.0:1788652446.860669:0:16538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:3.0:1788652446.860682:0:16538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+9:2347:x1875537603717888:12345-192.168.203.50@tcp:4:dd.0 00010000:00010000:3.0:1788652446.860711:0:16538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006842fa17/0x340ed74ef02a8c0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.860724:0:16538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652446.860735:0:16538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652446.860742:0:16538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006842fa17/0x340ed74ef02a8c0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.860754:0:16538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006842fa17/0x340ed74ef02a8c0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788652446.910641:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:2.0:1788652446.912914:0:14994:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:2.0:1788652446.912924:0:14994:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:2.0:1788652446.912939:0:14994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dab9ed5a/0x340ed74ef02a8bfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.912952:0:14994:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dab9ed5a/0x340ed74ef02a8bfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.912962:0:14994:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dab9ed5a/0x340ed74ef02a8bfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.912969:0:14994:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7fd11a00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:2.0:1788652446.912975:0:14994:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dab9ed5a/0x340ed74ef02a8bfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.912984:0:14994:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dab9ed5a/0x340ed74ef02a8bfc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.913024:0:14994:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dab9ed5a/0x340ed74ef02a8bfc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.913032:0:14994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dab9ed5a/0x340ed74ef02a8bfc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652446.915262:0:14994:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c66a6a95-dcf9-4296-ba30-508b18ee8b72+9:2348:x1875537603717760:12345-192.168.203.50@tcp:4:dd.0 Request processed in 169804us (170147us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788652446.915277:0:14994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 0 00000001:00080000:2.0:1788652446.955617:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:0.0:1788652446.955713:0:16538:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1788652446.955730:0:16538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006842fa17/0x340ed74ef02a8c0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.955743:0:16538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006842fa17/0x340ed74ef02a8c0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.955753:0:16538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006842fa17/0x340ed74ef02a8c0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.955759:0:16538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5000 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:0.0:1788652446.955764:0:16538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006842fa17/0x340ed74ef02a8c0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.955804:0:16538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006842fa17/0x340ed74ef02a8c0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.955836:0:16538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006842fa17/0x340ed74ef02a8c0a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.955845:0:16538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006842fa17/0x340ed74ef02a8c0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652446.956043:0:16538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+5:2347:x1875537603717888:12345-192.168.203.50@tcp:4:dd.0 Request processed in 95362us (196835us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788652446.956058:0:16538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 2 00000100:00100000:1.0:1788652446.961711:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652446.961750:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:0.0:1788652446.961870:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603718272 00000100:00100000:0.0:1788652446.961880:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603718272 00000100:00100000:0.0:1788652446.961942:0:14993:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603718144 00000100:00100000:0.0:1788652446.961946:0:14993:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603718144 00000100:00100000:0.0:1788652446.961980:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:0.0:1788652446.961990:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51383100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+6:2346:x1875537603718272:12345-192.168.203.50@tcp:4:dd.0 00002000:00010000:0.0:1788652446.962037:0:14993:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a9cab9d, atime: 0x6a9cab9c, ctime: 0x0, blocks: 0x1807 00010000:00010000:0.0:1788652446.962046:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c311a0bb/0x340ed74ef02a8c11 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.962062:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788652446.962067:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652446.962073:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c311a0bb/0x340ed74ef02a8c11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652446.962087:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c311a0bb/0x340ed74ef02a8c11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652446.962481:0:16538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:3.0:1788652446.962492:0:16538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51382d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+7:2346:x1875537603718144:12345-192.168.203.50@tcp:4:dd.0 00010000:00010000:3.0:1788652446.962510:0:16538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a8c18 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.962519:0:16538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652446.962522:0:16538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652446.962527:0:16538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a8c18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652446.962535:0:16538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a8c18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652446.969242:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652446.969283:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:3.0:1788652446.969323:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.50@tcp (source: 12345-192.168.203.50@tcp) 00000100:00100000:1.0:1788652446.969439:0:14994:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788652446.969450:0:14994:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1788652446.969590:0:14995:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788652446.969602:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603718528 00000100:00100000:2.0:1788652446.969610:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603718528 00000100:00100000:2.0:1788652446.969659:0:14995:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788652446.969665:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603718400 00000100:00100000:2.0:1788652446.969668:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603718400 00000100:00100000:2.0:1788652446.969682:0:14995:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788652446.969686:0:14995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537603718656 00000100:00100000:2.0:1788652446.969689:0:14995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537603718656 00000100:00100000:2.0:1788652446.970507:0:16540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 5 00000100:00100000:2.0:1788652446.970520:0:16540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c66a6a95-dcf9-4296-ba30-508b18ee8b72+11:2346:x1875537603718528:12345-192.168.203.50@tcp:4:dd.0 00010000:00010000:2.0:1788652446.970563:0:16540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000592a966a/0x340ed74ef02a8c1f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.970580:0:16540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652446.970585:0:16540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652446.970591:0:16540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000592a966a/0x340ed74ef02a8c1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652446.970612:0:16540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000592a966a/0x340ed74ef02a8c1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788652447.036408:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:0.0:1788652447.036821:0:14993:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 7340032 00002000:00010000:0.0:1788652447.036825:0:14993:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788652445 00002000:00010000:0.0:1788652447.036828:0:14993:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1788652447.036842:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c311a0bb/0x340ed74ef02a8c11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652447.036951:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c311a0bb/0x340ed74ef02a8c11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652447.036962:0:14993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c311a0bb/0x340ed74ef02a8c11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652447.036969:0:14993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75f1aa00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:0.0:1788652447.036974:0:14993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c311a0bb/0x340ed74ef02a8c11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652447.036985:0:14993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c311a0bb/0x340ed74ef02a8c11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652447.037006:0:14993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c311a0bb/0x340ed74ef02a8c11 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652447.037014:0:14993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c311a0bb/0x340ed74ef02a8c11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652447.039420:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51383100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+15:2346:x1875537603718272:12345-192.168.203.50@tcp:4:dd.0 Request processed in 75124us (75410us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788652447.039435:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 3 00000100:00100000:0.0:1788652447.039472:0:14993:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 6 00000100:00100000:0.0:1788652447.039488:0:14993:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+14:2346:x1875537603718400:12345-192.168.203.50@tcp:4:dd.0 00010000:00010000:0.0:1788652447.039525:0:14993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003be97ab9/0x340ed74ef02a8c26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652447.039542:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788652447.039546:0:14993:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652447.039562:0:14993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003be97ab9/0x340ed74ef02a8c26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652447.039578:0:14993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003be97ab9/0x340ed74ef02a8c26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652447.059625:0:15837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788652447.100798:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:3.0:1788652447.101856:0:16538:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:3.0:1788652447.101875:0:16538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a8c18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652447.101905:0:16538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a8c18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652447.101914:0:16538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a8c18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652447.101922:0:16540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000592a966a/0x340ed74ef02a8c1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652447.101979:0:16540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000592a966a/0x340ed74ef02a8c1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652447.101988:0:16538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e5400 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:0.0:1788652447.101988:0:16540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000592a966a/0x340ed74ef02a8c1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652447.101997:0:16538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a8c18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652447.102008:0:16538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a8c18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652447.102015:0:16540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75dd0a00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:0.0:1788652447.102031:0:16540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000592a966a/0x340ed74ef02a8c1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652447.102033:0:16538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a8c18 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652447.102051:0:16540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000592a966a/0x340ed74ef02a8c1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652447.102052:0:16538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8d24641/0x340ed74ef02a8c18 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652447.102081:0:16540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000592a966a/0x340ed74ef02a8c1f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652447.102090:0:16540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000592a966a/0x340ed74ef02a8c1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652447.102157:0:16540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75986300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c66a6a95-dcf9-4296-ba30-508b18ee8b72+11:2346:x1875537603718528:12345-192.168.203.50@tcp:4:dd.0 Request processed in 131633us (132918us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788652447.102158:0:16538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51382d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+11:2346:x1875537603718144:12345-192.168.203.50@tcp:4:dd.0 Request processed in 139661us (140399us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1788652447.102174:0:16538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 4 00000100:00100000:3.0:1788652447.102205:0:16538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:3.0:1788652447.102217:0:16538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe75987800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+10:2346:x1875537603718656:12345-192.168.203.50@tcp:4:dd.0 00010000:00010000:3.0:1788652447.102246:0:16538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c7cf882/0x340ed74ef02a8c2d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652447.102265:0:16538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652447.102270:0:16538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652447.102278:0:16538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c7cf882/0x340ed74ef02a8c2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652447.102291:0:16538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c7cf882/0x340ed74ef02a8c2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652447.102399:0:16540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 5 00000001:00080000:2.0:1788652447.129443:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:0.0:1788652447.129550:0:14993:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:0.0:1788652447.129564:0:14993:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:0.0:1788652447.129579:0:14993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003be97ab9/0x340ed74ef02a8c26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652447.129591:0:14993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003be97ab9/0x340ed74ef02a8c26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652447.129599:0:14993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003be97ab9/0x340ed74ef02a8c26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652447.129620:0:14993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe75f1ac00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:0.0:1788652447.129625:0:14993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003be97ab9/0x340ed74ef02a8c26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652447.129635:0:14993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003be97ab9/0x340ed74ef02a8c26 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652447.129657:0:14993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003be97ab9/0x340ed74ef02a8c26 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652447.129666:0:14993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003be97ab9/0x340ed74ef02a8c26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652447.129756:0:14993:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c66a6a95-dcf9-4296-ba30-508b18ee8b72+9:2346:x1875537603718400:12345-192.168.203.50@tcp:4:dd.0 Request processed in 90271us (160467us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788652447.129766:0:14993:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 6 00000001:00080000:2.0:1788652447.148425:0:6704:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:1.0:1788652447.148603:0:16538:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1788652447.148618:0:16538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c7cf882/0x340ed74ef02a8c2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652447.148629:0:16538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c7cf882/0x340ed74ef02a8c2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652447.148637:0:16538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c7cf882/0x340ed74ef02a8c2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652447.148644:0:16538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cbe7a0e4a00 already unused, calling callback (ffffffffc17b34f0) 00010000:00010000:1.0:1788652447.148648:0:16538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c7cf882/0x340ed74ef02a8c2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652447.148657:0:16538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c7cf882/0x340ed74ef02a8c2d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652447.148675:0:16538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c7cf882/0x340ed74ef02a8c2d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652447.148697:0:16538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c7cf882/0x340ed74ef02a8c2d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652447.148824:0:16538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe75987800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c66a6a95-dcf9-4296-ba30-508b18ee8b72+5:2346:x1875537603718656:12345-192.168.203.50@tcp:4:dd.0 Request processed in 46606us (179495us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788652447.148835:0:16538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.50@tcp, seq: 7 00000100:00100000:2.0:1788652447.880284:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f8d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627814784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788652447.880338:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627815040:0@lo:400:kworker.0 00000100:00100000:2.0:1788652447.880360:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652447.880379:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652447.880421:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe5f8fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875537627815296:0@lo:400:kworker.0 00000100:00100000:3.0:1788652447.880423:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f82dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875537627815552:0@lo:400:kworker.0 00000100:00100000:2.0:1788652447.880460:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652447.880468:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627815168:0@lo:400:kworker.0 00000100:00100000:2.0:1788652447.880491:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788652447.880500:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe75984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a384a7b-92b2-4f9e-a496-63aebbb65331:3305:1875537627814912:0@lo:400:kworker.0 00000100:00100000:3.0:1788652447.880501:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652447.880541:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652447.880577:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe7f82ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627815424:0@lo:400:kworker.0 00000100:00100000:2.0:1788652447.880600:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652447.880647:0:15716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627815296 00000100:00100000:2.0:1788652447.880654:0:15716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627815296 00000100:00100000:2.0:1788652447.880694:0:15716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627815424 00000100:00100000:2.0:1788652447.880697:0:15716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627815424 00000100:00100000:2.0:1788652447.880728:0:15716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788652447.880736:0:15716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875537627815296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652447.880811:0:15716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875537627815296:12345-0@lo:400:kworker.0 Request processed in 75us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652447.880819:0:15716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788652447.880849:0:15716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788652447.880855:0:15716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627815424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652447.880894:0:15716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875537627815424:12345-0@lo:400:kworker.0 Request processed in 40us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652447.880900:0:15716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788652447.880918:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652447.880931:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652447.880957:0:15716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627815552 00000100:00100000:2.0:1788652447.880960:0:15716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627815552 00000100:00100000:2.0:1788652447.880990:0:15716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788652447.880997:0:15716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875537627815552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652447.881104:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627814912 00000100:00100000:1.0:1788652447.881109:0:14298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627814912 00000100:00100000:1.0:1788652447.881139:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788652447.881146:0:14298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:3305:x1875537627814912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652447.881168:0:14992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627814784 00000100:00100000:0.0:1788652447.881180:0:14992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627814784 00000100:00100000:0.0:1788652447.881219:0:14992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788652447.881226:0:14992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f90c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627814784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788652447.881241:0:14992:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3859808256 avail 3849322496 00000100:00100000:3.0:1788652447.883142:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627815040 00000100:00100000:3.0:1788652447.883153:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627815040 00000100:00100000:3.0:1788652447.883209:0:14987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627815168 00000100:00100000:3.0:1788652447.883212:0:14987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627815168 00000100:00100000:3.0:1788652447.883944:0:14987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788652447.883968:0:14987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe7f82c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875537627815040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652447.885877:0:14298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a384a7b-92b2-4f9e-a496-63aebbb65331+19:3305:x1875537627814912:12345-0@lo:400:kworker.0 Request processed in 4721us (5325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652447.885891:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788652447.886162:0:15835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788652447.886176:0:15835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe493b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627815168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652447.886225:0:15835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe493b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875537627815168:12345-0@lo:400:kworker.0 Request processed in 55us (5726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652447.886231:0:15835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788652447.886255:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788652447.886261:0:14300:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788652447.886301:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f82dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875537627815552:0@lo:400:kworker.0 00000100:00100000:1.0:1788652447.886319:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788652447.886333:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cbe51381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627815680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788652447.886365:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652447.886415:0:14991:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788652447.886423:0:14991:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1788652447.886448:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75984e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a384a7b-92b2-4f9e-a496-63aebbb65331:3305:1875537627814912:0@lo:400:kworker.0 00000100:00100000:1.0:1788652447.886460:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f82ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875537627815424:0@lo:400:kworker.0 00000100:00100000:1.0:1788652447.886756:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe5f8fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875537627815296:0@lo:400:kworker.0 00000100:00100000:1.0:1788652447.887128:0:14991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537627815680 00000100:00100000:1.0:1788652447.887135:0:14991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537627815680 00000100:00100000:1.0:1788652447.887224:0:16541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788652447.887233:0:16541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cbe51380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627815680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788652447.887264:0:16541:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788652447.887313:0:16541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe51380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875537627815680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652447.887320:0:16541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788652447.887352:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe51381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627815680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788652447.887409:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875537627815168:0@lo:400:kworker.0 00000100:00100000:3.0:1788652447.888501:0:14987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f82c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875537627815040:12345-0@lo:400:kworker.0 Request processed in 4535us (8118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652447.888512:0:14987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788652447.889415:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1788652447.889424:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cbe51381c00, transno 8589934595 00000004:00080000:1.0:1788652447.889436:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1788652447.889461:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe75985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875537627815040:0@lo:400:kworker.0 00000100:00100000:0.0:1788652447.892752:0:14992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875537627814784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11517us (12383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652447.892765:0:14992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788652447.892983:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cbe7f8d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875537627814784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788652447.893841:0:15716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cbe7f90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875537627815552:12345-0@lo:400:kworker.0 Request processed in 12841us (12904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652447.893853:0:15716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788652448.071996:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788652449.058923:0:16578:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1788652449.097028:0:14293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652450.124820:0:15837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652451.153682:0:14292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29030 lines, 29030 kept, 0 dropped, 0 bad.